[ 561.636333] env[68109]: INFO neutron.common.config [-] Logging enabled! [ 561.636333] env[68109]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev85 [ 561.636633] env[68109]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=68109) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 561.637388] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 561.637388] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 561.637700] env[68109]: WARNING oslo_policy.policy [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 561.637921] env[68109]: WARNING oslo_policy.policy [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 561.639876] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] VMware NSXv3 Agent initialized successfully. [ 561.640435] env[68109]: DEBUG oslo_concurrency.lockutils [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] Acquiring lock "singleton_lock" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.640435] env[68109]: DEBUG oslo_concurrency.lockutils [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] Acquired lock "singleton_lock" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.640580] env[68109]: DEBUG oslo_concurrency.lockutils [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] Releasing lock "singleton_lock" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.640856] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] Full set of CONF: {{(pid=68109) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 561.641073] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ******************************************************************************** {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 561.641220] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] Configuration options gathered from: {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 561.641473] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 561.643535] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 561.643535] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ================================================================================ {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 561.643535] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] agent_down_time = 75 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643535] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] allow_automatic_dhcp_failover = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643535] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] allow_bulk = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643535] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] api_extensions_path = {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643709] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] api_paste_config = api-paste.ini {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643709] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] auth_strategy = keystone {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643709] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] backdoor_port = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643709] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] backdoor_socket = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643709] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] backlog = 4096 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643709] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] base_mac = fa:16:3e:00:00:00 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643709] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] bind_host = 0.0.0.0 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643889] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] bind_port = 9696 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643889] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] client_socket_timeout = 900 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643889] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] config_dir = [] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643889] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.643989] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] config_source = [] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.644160] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] control_exchange = neutron {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.644255] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] core_plugin = ml2 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.644395] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] debug = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.644533] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] default_availability_zones = [] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.644742] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.644881] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] dhcp_agent_notification = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.645029] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] dhcp_agents_per_network = 1 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.645167] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] dhcp_lease_duration = 86400 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.645314] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] dhcp_load_type = networks {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.645453] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] dns_domain = openstacklocal {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.645593] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.645726] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] enable_default_route_bfd = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.645858] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] enable_default_route_ecmp = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.645989] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] enable_dvr = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.646136] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] enable_new_agents = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.646359] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.646438] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] enable_signals = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.647123] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] enable_traditional_dhcp = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.647123] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] external_dns_driver = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.647123] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] filter_validation = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.647123] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] global_physnet_mtu = 8950 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.647123] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] graceful_shutdown_timeout = 60 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.647305] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] host = cpu-1 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.647401] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] host_dvr_for_dhcp = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.647516] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] http_retries = 3 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.647656] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] instance_format = [instance: %(uuid)s] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.647792] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.647927] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ipam_driver = internal {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.648068] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ipv6_pd_enabled = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.648213] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] l3_ha = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.648336] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.648870] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] l3_ha_network_physical_name = {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.648870] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] l3_ha_network_type = {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.648870] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] log_color = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.648870] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] log_config_append = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.649133] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.649184] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] log_dir = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.649269] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] log_file = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.649373] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] log_options = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.649509] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] log_rotate_interval = 1 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.649649] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] log_rotate_interval_type = days {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.649833] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] log_rotation_type = none {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.649908] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.650320] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.650320] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.650320] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.650448] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.650529] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] max_dns_nameservers = 5 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.650667] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] max_header_line = 16384 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.651167] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] max_l3_agents_per_router = 3 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.651167] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] max_logfile_count = 30 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.651167] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] max_logfile_size_mb = 200 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.651704] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] max_subnet_host_routes = 20 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.651704] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] my_ip = 10.180.1.21 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.651704] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] my_ipv6 = ::1 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.651704] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] network_auto_schedule = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.651892] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] network_link_prefix = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.651941] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.652361] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] notify_nova_on_port_data_changes = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.652361] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] notify_nova_on_port_status_changes = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.652361] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] pagination_max_limit = -1 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.652535] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] publish_errors = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.652637] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] rate_limit_burst = 0 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.652782] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] rate_limit_except_level = CRITICAL {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.652918] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] rate_limit_interval = 0 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.653598] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] retry_until_window = 30 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.653598] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] router_distributed = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.653598] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] rpc_resources_processing_step = 20 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.653598] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] rpc_response_max_timeout = 600 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.653598] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] rpc_response_timeout = 60 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.653961] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] send_events_interval = 2 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.653961] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] service_plugins = ['router'] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.654083] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] setproctitle = on {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.654179] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] shell_completion = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.654319] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] state_path = /opt/stack/data/neutron {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.654458] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] syslog_log_facility = LOG_USER {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.654595] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] tcp_keepidle = 600 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.654843] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] transport_url = **** {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.654914] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] use_journal = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.655012] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] use_json = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.655529] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] use_ssl = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.655529] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] use_stderr = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.655529] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] use_syslog = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.655647] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] vlan_qinq = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.655680] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] vlan_transparent = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.656061] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] watch_log_file = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.656061] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] wsgi_default_pool_size = 100 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.656220] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] wsgi_keep_alive = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.656270] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.656370] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] wsgi_server_debug = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 561.656716] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_concurrency.disable_process_locking = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.656716] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.656856] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.657014] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.657695] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.657695] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.657695] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.657695] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] profiler.connection_string = messaging:// {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.657695] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] profiler.enabled = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.657842] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] profiler.es_doc_type = notification {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.657990] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] profiler.es_scroll_size = 10000 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.658152] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] profiler.es_scroll_time = 2m {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.658439] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] profiler.filter_error_trace = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.658439] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] profiler.hmac_keys = **** {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.658578] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] profiler.sentinel_service_name = mymaster {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.659012] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] profiler.socket_timeout = 0.1 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.659012] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] profiler.trace_requests = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.659012] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] profiler.trace_sqlalchemy = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.659206] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] profiler_jaeger.process_tags = {} {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.659568] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] profiler_jaeger.service_name_prefix = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.659568] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] profiler_otlp.service_name_prefix = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.659634] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_policy.enforce_new_defaults = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.659969] env[68109]: WARNING oslo_config.cfg [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 561.660081] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_policy.enforce_scope = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.660381] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_policy.policy_default_rule = default {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.660381] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.660468] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.660767] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.660767] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.660849] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.661208] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.661208] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.661595] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_policy.remote_timeout = 60.0 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.661595] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.661595] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] agent.extensions = [] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.661769] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.662565] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] service_providers.service_provider = [] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.662565] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] QUOTAS.default_quota = -1 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.662565] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.662565] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] QUOTAS.quota_floatingip = 50 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.662565] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] QUOTAS.quota_network = 100 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.662715] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] QUOTAS.quota_port = 500 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.662799] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.662903] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] QUOTAS.quota_router = 10 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.663049] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] QUOTAS.quota_security_group = 10 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.663218] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.663360] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] QUOTAS.quota_subnet = 100 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.664058] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] QUOTAS.track_quota_usage = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.664058] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.664058] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep.group = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.664058] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep.helper_command = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.664058] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.664237] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep.thread_pool_size = 8 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.664348] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep.user = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.664489] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.664630] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_dhcp_release.group = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.665428] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_dhcp_release.helper_command = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.665428] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.665428] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.665428] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_dhcp_release.user = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.665428] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.665586] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_ovs_vsctl.group = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.665617] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_ovs_vsctl.helper_command = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.665735] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.665874] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.666034] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_ovs_vsctl.user = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.666163] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_namespace.capabilities = [21] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.666296] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_namespace.group = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.666591] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_namespace.helper_command = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.666591] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.666804] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_namespace.thread_pool_size = 8 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.666931] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_namespace.user = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.667531] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_conntrack.capabilities = [12] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.667531] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_conntrack.group = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.667531] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_conntrack.helper_command = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.667531] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.667531] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.667700] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_conntrack.user = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.667782] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_link.capabilities = [12, 21] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.667916] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_link.group = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.668274] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_link.helper_command = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.668274] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.668377] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_link.thread_pool_size = 8 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.669050] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] privsep_link.user = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.669050] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.669050] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.669050] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.continue_on_failed_promotions = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.669050] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.dscp = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.669276] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.dscp_inherit = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.669419] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.force_mp_to_policy = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.669507] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.locking_coordinator_url = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.669637] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.log_agent_heartbeats = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.669781] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.logging_expire = 1 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.669928] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.670083] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.670238] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.polling_interval = 240 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.670386] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.670538] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.670685] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.report_interval = 30.0 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.670832] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.670979] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.671168] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.671356] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.sync_skew = 60 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.671456] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.synchronization_queue_size = 20 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.671603] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT.use_helper_for_ns_read = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.671761] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] SECURITYGROUP.enable_ipset = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.671898] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] SECURITYGROUP.enable_security_group = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.672054] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.672214] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.672411] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] experimental.ipv6_pd_enabled = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.672560] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ml2.extension_drivers = ['port_security'] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.672682] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ml2.external_network_type = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.672844] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.672982] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ml2.overlay_ip_version = 4 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.673149] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ml2.path_mtu = 8950 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.673308] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ml2.physical_network_mtus = {} {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.673445] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ml2.tenant_network_types = ['vlan'] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.673594] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.673770] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ml2.type_drivers = ['vlan'] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.673888] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT_CLI.neutron_port_id = [] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.674039] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.674183] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.674337] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.674493] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.674640] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.674792] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.674940] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.675111] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.675335] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.675490] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_login_password = **** {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.675641] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_login_port = 443 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.675788] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_login_user = admin {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.675932] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.676096] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.676245] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.676386] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.676538] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.676687] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.676834] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.676979] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.677136] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.677303] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.677486] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.677652] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.677778] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.677970] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.678139] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] vsphere.vsphere_login_password = VMware1! {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.678305] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.678465] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.678610] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] nova.auth_section = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.678765] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] nova.auth_type = password {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.678914] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.679063] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] nova.certfile = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.679213] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] nova.collect_timing = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.679364] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] nova.endpoint_type = public {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.679504] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] nova.insecure = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.679642] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] nova.keyfile = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.679790] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] nova.region_name = RegionOne {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.679930] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] nova.split_loggers = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.680082] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] nova.timeout = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.680229] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] placement.auth_section = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.680382] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] placement.auth_type = password {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.680530] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.680667] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] placement.certfile = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.680808] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] placement.collect_timing = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.680955] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] placement.endpoint_type = public {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.681128] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] placement.insecure = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.681267] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] placement.keyfile = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.681408] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] placement.region_name = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.681548] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] placement.split_loggers = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.681688] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] placement.timeout = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.681834] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.auth_section = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.681974] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.auth_type = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.682125] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.cafile = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.682279] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.certfile = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.682429] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.collect_timing = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.682566] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.connect_retries = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.682705] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.connect_retry_delay = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.682839] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.enable_notifications = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.682974] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.endpoint_override = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.683128] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.insecure = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.683265] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.interface = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.683398] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.keyfile = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.683532] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.max_version = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.683663] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.min_version = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.683828] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.region_name = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.683946] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.retriable_status_codes = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.684066] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.service_name = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.684204] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.service_type = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.684344] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.split_loggers = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.684479] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.status_code_retries = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.684612] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.status_code_retry_delay = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.684749] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.timeout = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.684884] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.valid_interfaces = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.685026] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ironic.version = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.685175] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] cli_script.dry_run = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.685325] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.685460] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.685602] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.685739] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.685884] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.686042] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.686186] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.686324] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.686461] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.686612] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.686750] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.686899] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.687056] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.687203] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.687337] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.687487] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.687626] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.687767] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.687965] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.688063] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.688254] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.688367] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.688486] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.688631] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.688770] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.688912] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.689065] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.689210] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.689352] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.689494] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.689643] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.ssl = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.689795] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.689943] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.690094] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.690241] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.690385] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.ssl_version = {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.690524] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.690672] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_notifications.driver = [] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.690813] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_notifications.retry = -1 {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.690973] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.691134] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] oslo_messaging_notifications.transport_url = **** {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 561.691251] env[68109]: DEBUG oslo_service.backend.eventlet.service [None req-17dea848-7760-4b77-bc52-c6ec20b5f860 None None] ******************************************************************************** {{(pid=68109) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 561.692259] env[68109]: DEBUG neutron.agent.securitygroups_rpc [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Init firewall settings (driver=nsxv3) {{(pid=68109) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 561.697295] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=68109) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 561.697295] env[68109]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] RPC agent_id: nsxm-l-01a.corp.local [ 561.697295] env[68109]: DEBUG dogpile.cache.region [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 561.697295] env[68109]: DEBUG dogpile.lock [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 561.697295] env[68109]: DEBUG dogpile.lock [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 561.697295] env[68109]: DEBUG dogpile.lock [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 561.697295] env[68109]: DEBUG dogpile.cache.region [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 561.697578] env[68109]: DEBUG dogpile.lock [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 561.697578] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 561.717724] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Session token - acquiring [ 561.719273] env[68109]: DEBUG networking_nsxv3.common.locking [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.719461] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.719567] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.719984] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.729799] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.994934] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 562.014449] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 562.014607] env[68109]: DEBUG dogpile.cache.region [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Cache value generated in 0.318 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 562.014702] env[68109]: DEBUG dogpile.lock [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 562.014820] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Activating Policy API Provider. [ 562.015028] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Looking for the default Infrastructure Rules. [ 562.077658] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Looking for the Default Layer3 Logged Drop Section. [ 562.092101] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 562.092542] env[68109]: DEBUG networking_nsxv3.common.locking [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.092723] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquiring lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.092806] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.093093] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired external semaphore "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.093433] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 562.608441] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.110514] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.613361] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Inventory metadata is going to be refreshed. [ 563.613603] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 564.349101] env[68109]: DEBUG networking_nsxv3.common.locking [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.349611] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.349611] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.349732] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.361697] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 564.363722] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.364360] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 564.381708] env[68109]: DEBUG networking_nsxv3.common.locking [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.381930] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.382024] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.382285] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.382410] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.382550] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 564.382666] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 564.382770] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 564.402101] env[68109]: DEBUG networking_nsxv3.common.locking [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.402345] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.402415] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.402657] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.402820] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.402956] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 564.421457] env[68109]: DEBUG networking_nsxv3.common.locking [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.421709] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.421798] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.422036] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.422188] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.422337] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 564.439638] env[68109]: DEBUG networking_nsxv3.common.locking [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.439852] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquiring lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.439952] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.440255] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired external semaphore "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.440400] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Releasing lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.440545] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 564.440652] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 564.440755] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 564.458549] env[68109]: DEBUG networking_nsxv3.common.locking [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.458800] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquiring lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.458878] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.459130] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired external semaphore "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.459284] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Releasing lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.459468] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 564.459541] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 564.459641] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 564.478128] env[68109]: DEBUG networking_nsxv3.common.locking [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.478309] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.478414] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.478670] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.478852] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.478958] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 564.479076] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 564.479207] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Inventory metadata have been refreshed. [ 564.479324] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Dryrun:True. Metadata refresh completed. [ 564.479449] env[68109]: DEBUG oslo_concurrency.lockutils [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Releasing lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.481187] env[68109]: INFO neutron.agent.agent_extensions_manager [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Loaded agent extensions: [] [ 564.481873] env[68109]: DEBUG neutron_lib.callbacks.manager [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=68109) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 564.638425] env[68109]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] NSXv3 Agent Agent RPC Daemon Started! [ 564.638668] env[68109]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] NSXv3 Agent Agent loop - iteration:0 started [ 564.638765] env[68109]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] NSXv3 Agent Agent out of sync with plugin! [ 569.482760] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 569.483199] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 574.484531] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 574.484898] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 578.502228] env[68109]: INFO networking_nsxv3.common.synchronization [None req-6dd6bdee-f816-4b6e-93de-2f34edf788b6 demo admin] Enqueued Resource ID: 673ba2f7-85d2-4503-967d-f27dba749ca6 with Priority: HIGHEST for action security_group_rules [ 578.502228] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 673ba2f7-85d2-4503-967d-f27dba749ca6 with Priority: HIGHEST for action security_group_rules [ 578.502228] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-673ba2f7-85d2-4503-967d-f27dba749ca6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.502228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-673ba2f7-85d2-4503-967d-f27dba749ca6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.502228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-673ba2f7-85d2-4503-967d-f27dba749ca6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.502228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-673ba2f7-85d2-4503-967d-f27dba749ca6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.502228] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('673ba2f7-85d2-4503-967d-f27dba749ca6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.022478] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.022722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.022722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.023084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.023084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.023084] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 673ba2f7-85d2-4503-967d-f27dba749ca6 already deleted. [ 579.023302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-673ba2f7-85d2-4503-967d-f27dba749ca6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.484682] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.485078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.485078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.485078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.485382] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.988173] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.490391] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.992549] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 582.992731] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 583.501231] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 583.501669] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 583.776202] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.776482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.776482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.776600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.788276] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 583.789053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.789648] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 583.805474] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.805603] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.805656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.805833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.805915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.806030] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 583.806104] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 583.806175] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 583.824952] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.825092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.825157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.825317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.825439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.825538] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 583.842255] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.842364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.842442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.842628] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.842724] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.842817] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 583.861175] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.861344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.861344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.861531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.861623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.861723] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 583.861795] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 583.861862] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 583.879480] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.879595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.879666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.879804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.879883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.879977] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 583.880058] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 583.880126] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 583.897082] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.897228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.897292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.897404] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.897496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.897597] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 583.897668] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 583.897734] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 583.897799] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 583.898029] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 583.898029] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 583.898029] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 583.898232] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 583.898298] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 583.898362] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 583.914588] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.914727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.914780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.914915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.915016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.915115] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 583.931037] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.931170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.931220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.931373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.931495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.942377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.502399] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 588.502671] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 593.504265] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 593.504577] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 598.505405] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 598.506075] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 603.508197] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 603.508197] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 605.440834] env[68109]: INFO networking_nsxv3.common.synchronization [None req-6493b4eb-e814-47b4-9726-99c7a02ca9a2 None None] Enqueued Resource ID: 1a4a62ce-4e1c-4995-a43e-7409ad7d3f63 with Priority: HIGHEST for action port [ 605.441123] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a4a62ce-4e1c-4995-a43e-7409ad7d3f63 with Priority: HIGHEST for action port [ 605.441614] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a4a62ce-4e1c-4995-a43e-7409ad7d3f63 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.441799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a4a62ce-4e1c-4995-a43e-7409ad7d3f63" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.441869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a4a62ce-4e1c-4995-a43e-7409ad7d3f63" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.444428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a4a62ce-4e1c-4995-a43e-7409ad7d3f63" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.444537] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a4a62ce-4e1c-4995-a43e-7409ad7d3f63',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.949909] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a4a62ce-4e1c-4995-a43e-7409ad7d3f63 [ 605.949909] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.949909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.949909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.949909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.949909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.949909] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a4a62ce-4e1c-4995-a43e-7409ad7d3f63 already deleted. [ 605.949909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a4a62ce-4e1c-4995-a43e-7409ad7d3f63" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.056664] env[68109]: INFO networking_nsxv3.common.synchronization [None req-82b6757c-f6ec-4765-ab59-56e117ecb854 None None] Enqueued Resource ID: 03c116e7-cdda-42b5-abd6-a3cb763805e2 with Priority: HIGHEST for action port [ 607.056664] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c116e7-cdda-42b5-abd6-a3cb763805e2 with Priority: HIGHEST for action port [ 607.056664] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-03c116e7-cdda-42b5-abd6-a3cb763805e2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.056664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03c116e7-cdda-42b5-abd6-a3cb763805e2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.056664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03c116e7-cdda-42b5-abd6-a3cb763805e2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.057557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03c116e7-cdda-42b5-abd6-a3cb763805e2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.057680] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03c116e7-cdda-42b5-abd6-a3cb763805e2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.386726] env[68109]: INFO networking_nsxv3.common.synchronization [None req-efa7a25c-4b63-462e-b373-6da2d0dae92f None None] Enqueued Resource ID: 42f7a63c-da97-4e9f-a947-45bcc9776812 with Priority: HIGHEST for action port [ 607.386991] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42f7a63c-da97-4e9f-a947-45bcc9776812 with Priority: HIGHEST for action port [ 607.387557] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-42f7a63c-da97-4e9f-a947-45bcc9776812 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.387657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42f7a63c-da97-4e9f-a947-45bcc9776812" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.387725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42f7a63c-da97-4e9f-a947-45bcc9776812" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.387963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42f7a63c-da97-4e9f-a947-45bcc9776812" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.389125] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42f7a63c-da97-4e9f-a947-45bcc9776812',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.559811] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03c116e7-cdda-42b5-abd6-a3cb763805e2 [ 607.561092] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.561948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.561948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.561948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.561948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.561948] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03c116e7-cdda-42b5-abd6-a3cb763805e2 already deleted. [ 607.561948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03c116e7-cdda-42b5-abd6-a3cb763805e2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.892043] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42f7a63c-da97-4e9f-a947-45bcc9776812 [ 607.892373] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.892491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.892491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.892698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.892871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.892940] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42f7a63c-da97-4e9f-a947-45bcc9776812 already deleted. [ 607.893060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42f7a63c-da97-4e9f-a947-45bcc9776812" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.277438] env[68109]: INFO networking_nsxv3.common.synchronization [None req-e0b90707-8c8b-4a61-91b7-808f02124ee9 None None] Enqueued Resource ID: a088c1e6-8647-4da1-b772-e19c999e8d70 with Priority: HIGHEST for action port [ 608.277438] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a088c1e6-8647-4da1-b772-e19c999e8d70 with Priority: HIGHEST for action port [ 608.277438] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-a088c1e6-8647-4da1-b772-e19c999e8d70 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.277799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a088c1e6-8647-4da1-b772-e19c999e8d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.277799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a088c1e6-8647-4da1-b772-e19c999e8d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.277893] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a088c1e6-8647-4da1-b772-e19c999e8d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.278814] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a088c1e6-8647-4da1-b772-e19c999e8d70',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.781145] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a088c1e6-8647-4da1-b772-e19c999e8d70 [ 608.781382] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.781664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.781664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.781846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.781937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.782043] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a088c1e6-8647-4da1-b772-e19c999e8d70 already deleted. [ 608.782122] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a088c1e6-8647-4da1-b772-e19c999e8d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.607142] env[68109]: INFO networking_nsxv3.common.synchronization [None req-51648fce-057d-4668-acfb-25436bf632d1 None None] Enqueued Resource ID: 8a72a5aa-b1f9-49f8-8941-ad71901e1416 with Priority: HIGHEST for action port [ 609.611170] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a72a5aa-b1f9-49f8-8941-ad71901e1416 with Priority: HIGHEST for action port [ 609.611170] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a72a5aa-b1f9-49f8-8941-ad71901e1416 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.611170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a72a5aa-b1f9-49f8-8941-ad71901e1416" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.611170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a72a5aa-b1f9-49f8-8941-ad71901e1416" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.611170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a72a5aa-b1f9-49f8-8941-ad71901e1416" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.611170] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a72a5aa-b1f9-49f8-8941-ad71901e1416',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.110845] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a72a5aa-b1f9-49f8-8941-ad71901e1416 [ 610.111089] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.111244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.111309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.111500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.111592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.111687] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a72a5aa-b1f9-49f8-8941-ad71901e1416 already deleted. [ 610.111790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a72a5aa-b1f9-49f8-8941-ad71901e1416" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.318118] env[68109]: INFO networking_nsxv3.common.synchronization [None req-308b3192-372d-4c81-bb7d-7bd4c034462e None None] Enqueued Resource ID: ddd9751d-1547-4e82-b9aa-d4aec780d6a9 with Priority: HIGHEST for action port [ 610.318118] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddd9751d-1547-4e82-b9aa-d4aec780d6a9 with Priority: HIGHEST for action port [ 610.318471] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddd9751d-1547-4e82-b9aa-d4aec780d6a9 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.320061] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddd9751d-1547-4e82-b9aa-d4aec780d6a9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.320061] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddd9751d-1547-4e82-b9aa-d4aec780d6a9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.320061] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddd9751d-1547-4e82-b9aa-d4aec780d6a9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.320061] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd9751d-1547-4e82-b9aa-d4aec780d6a9',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.502452] env[68109]: INFO networking_nsxv3.common.synchronization [None req-0aa2badd-eaa1-4377-8440-45320c68f13d None None] Enqueued Resource ID: 48edcfe2-8c8a-464f-b570-61ad740354d5 with Priority: HIGHEST for action port [ 610.504922] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48edcfe2-8c8a-464f-b570-61ad740354d5 with Priority: HIGHEST for action port [ 610.505546] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-48edcfe2-8c8a-464f-b570-61ad740354d5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.505667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48edcfe2-8c8a-464f-b570-61ad740354d5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.505743] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48edcfe2-8c8a-464f-b570-61ad740354d5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.509020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48edcfe2-8c8a-464f-b570-61ad740354d5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.509020] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48edcfe2-8c8a-464f-b570-61ad740354d5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.652410] env[68109]: INFO networking_nsxv3.common.synchronization [None req-4fd6edca-d2b0-462a-854d-8663fe92618a None None] Enqueued Resource ID: 311e56e0-3803-4ff1-a618-ad9492ed50c1 with Priority: HIGHEST for action port [ 610.652926] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 311e56e0-3803-4ff1-a618-ad9492ed50c1 with Priority: HIGHEST for action port [ 610.656016] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-311e56e0-3803-4ff1-a618-ad9492ed50c1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.656016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-311e56e0-3803-4ff1-a618-ad9492ed50c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.656016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-311e56e0-3803-4ff1-a618-ad9492ed50c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.656016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-311e56e0-3803-4ff1-a618-ad9492ed50c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.656016] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('311e56e0-3803-4ff1-a618-ad9492ed50c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.821512] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddd9751d-1547-4e82-b9aa-d4aec780d6a9 [ 610.821799] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.822120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.822120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.822318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.823186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.823186] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddd9751d-1547-4e82-b9aa-d4aec780d6a9 already deleted. [ 610.823186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddd9751d-1547-4e82-b9aa-d4aec780d6a9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.986211] env[68109]: INFO networking_nsxv3.common.synchronization [None req-5ca86617-8e8a-4ec5-9db6-c37c323544e6 None None] Enqueued Resource ID: 0ff5010d-5ae2-41d9-a770-3a1f9ed92d47 with Priority: HIGHEST for action port [ 610.986632] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff5010d-5ae2-41d9-a770-3a1f9ed92d47 with Priority: HIGHEST for action port [ 610.987089] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ff5010d-5ae2-41d9-a770-3a1f9ed92d47 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.987158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ff5010d-5ae2-41d9-a770-3a1f9ed92d47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.987922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ff5010d-5ae2-41d9-a770-3a1f9ed92d47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.987922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ff5010d-5ae2-41d9-a770-3a1f9ed92d47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.987922] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ff5010d-5ae2-41d9-a770-3a1f9ed92d47',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.010208] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48edcfe2-8c8a-464f-b570-61ad740354d5 [ 611.010208] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.010208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.010208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.010208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.010208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.012363] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48edcfe2-8c8a-464f-b570-61ad740354d5 already deleted. [ 611.012363] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48edcfe2-8c8a-464f-b570-61ad740354d5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.157124] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 311e56e0-3803-4ff1-a618-ad9492ed50c1 [ 611.157124] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.157124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.157124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.157124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.157124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.157124] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:311e56e0-3803-4ff1-a618-ad9492ed50c1 already deleted. [ 611.157124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-311e56e0-3803-4ff1-a618-ad9492ed50c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.494187] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ff5010d-5ae2-41d9-a770-3a1f9ed92d47 [ 611.494410] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.494744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.494744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.494879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.494921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.494981] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ff5010d-5ae2-41d9-a770-3a1f9ed92d47 already deleted. [ 611.496303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ff5010d-5ae2-41d9-a770-3a1f9ed92d47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.685950] env[68109]: INFO networking_nsxv3.common.synchronization [None req-14da14ad-1c73-46bb-949c-225baba6073b None None] Enqueued Resource ID: b911c20b-3542-4aca-98e3-eadaa4edd086 with Priority: HIGHEST for action port [ 611.686245] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b911c20b-3542-4aca-98e3-eadaa4edd086 with Priority: HIGHEST for action port [ 611.688752] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-b911c20b-3542-4aca-98e3-eadaa4edd086 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.688752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b911c20b-3542-4aca-98e3-eadaa4edd086" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.688752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b911c20b-3542-4aca-98e3-eadaa4edd086" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.692589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b911c20b-3542-4aca-98e3-eadaa4edd086" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.692683] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b911c20b-3542-4aca-98e3-eadaa4edd086',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.752347] env[68109]: INFO networking_nsxv3.common.synchronization [None req-b7628d20-8f72-4651-a867-b1de18d57c97 None None] Enqueued Resource ID: cf4b3d77-9d97-471c-b20f-c6b359b368f2 with Priority: HIGHEST for action port [ 611.752347] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf4b3d77-9d97-471c-b20f-c6b359b368f2 with Priority: HIGHEST for action port [ 611.752347] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf4b3d77-9d97-471c-b20f-c6b359b368f2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.752347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf4b3d77-9d97-471c-b20f-c6b359b368f2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.752347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf4b3d77-9d97-471c-b20f-c6b359b368f2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.754619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf4b3d77-9d97-471c-b20f-c6b359b368f2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.754619] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf4b3d77-9d97-471c-b20f-c6b359b368f2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.195618] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b911c20b-3542-4aca-98e3-eadaa4edd086 [ 612.196536] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.196536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.196536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.199265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.199368] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.199476] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b911c20b-3542-4aca-98e3-eadaa4edd086 already deleted. [ 612.199560] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b911c20b-3542-4aca-98e3-eadaa4edd086" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.256333] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf4b3d77-9d97-471c-b20f-c6b359b368f2 [ 612.257661] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.257661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.257661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.257661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.257661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.257661] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf4b3d77-9d97-471c-b20f-c6b359b368f2 already deleted. [ 612.257661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf4b3d77-9d97-471c-b20f-c6b359b368f2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.411088] env[68109]: INFO networking_nsxv3.common.synchronization [None req-cebf981b-ec13-4cdd-bc88-566269dc4024 tempest-ServersTestManualDisk-984063323 tempest-ServersTestManualDisk-984063323-project-member] Enqueued Resource ID: d2db7fe9-82f8-4d20-b269-363d052050b8 with Priority: HIGHEST for action security_group_rules [ 612.414360] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2db7fe9-82f8-4d20-b269-363d052050b8 with Priority: HIGHEST for action security_group_rules [ 612.414699] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2db7fe9-82f8-4d20-b269-363d052050b8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.414832] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.414887] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.415725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.415725] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2db7fe9-82f8-4d20-b269-363d052050b8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.531843] env[68109]: INFO networking_nsxv3.common.synchronization [None req-9b134fce-2cd7-4dd1-8364-3eeb7dde9e5b tempest-ServersTestManualDisk-984063323 tempest-ServersTestManualDisk-984063323-project-member] Enqueued Resource ID: d2db7fe9-82f8-4d20-b269-363d052050b8 with Priority: HIGHEST for action security_group_rules [ 612.533066] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2db7fe9-82f8-4d20-b269-363d052050b8 with Priority: HIGHEST for action security_group_rules [ 612.533066] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2db7fe9-82f8-4d20-b269-363d052050b8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.533066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.935995] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.935995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.935995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.935995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.935995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.936602] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2db7fe9-82f8-4d20-b269-363d052050b8 already deleted. [ 612.936602] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.936602] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.936602] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.936602] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2db7fe9-82f8-4d20-b269-363d052050b8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.963235] env[68109]: INFO networking_nsxv3.common.synchronization [None req-d60f89c6-c1a6-4ec6-b16e-01a623926866 None None] Enqueued Resource ID: 8777083e-d75e-4252-802f-188e0fa7fadd with Priority: HIGHEST for action port [ 612.964025] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8777083e-d75e-4252-802f-188e0fa7fadd with Priority: HIGHEST for action port [ 612.964998] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-8777083e-d75e-4252-802f-188e0fa7fadd taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.965153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8777083e-d75e-4252-802f-188e0fa7fadd" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.965416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8777083e-d75e-4252-802f-188e0fa7fadd" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.965660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8777083e-d75e-4252-802f-188e0fa7fadd" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.965747] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8777083e-d75e-4252-802f-188e0fa7fadd',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.457252] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.457252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.457252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.457252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.457252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.457252] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2db7fe9-82f8-4d20-b269-363d052050b8 already deleted. [ 613.457252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.468186] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8777083e-d75e-4252-802f-188e0fa7fadd [ 613.468343] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.468593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.468660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.469543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.469543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.469543] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8777083e-d75e-4252-802f-188e0fa7fadd already deleted. [ 613.469543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8777083e-d75e-4252-802f-188e0fa7fadd" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.960019] env[68109]: INFO networking_nsxv3.common.synchronization [req-34659853-2b63-4d4e-9a40-8390138b2585 req-fc477b00-4ec5-4cb9-a0a9-fbb022707dee tempest-DeleteServersAdminTestJSON-886050253 tempest-DeleteServersAdminTestJSON-886050253-project-member] Enqueued Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_members [ 614.960019] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_members [ 614.961451] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.962327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.962327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.964064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.964181] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.964557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.964557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.964557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.964757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.964757] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.265066] env[68109]: INFO networking_nsxv3.common.synchronization [None req-fe06978f-1c0a-49c3-b76a-e68102772554 None None] Enqueued Resource ID: 31499166-d592-4206-a00f-a5ed77c0a6f9 with Priority: HIGHEST for action port [ 615.265282] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31499166-d592-4206-a00f-a5ed77c0a6f9 with Priority: HIGHEST for action port [ 615.265860] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-31499166-d592-4206-a00f-a5ed77c0a6f9 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.266019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31499166-d592-4206-a00f-a5ed77c0a6f9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.266084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31499166-d592-4206-a00f-a5ed77c0a6f9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.267986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31499166-d592-4206-a00f-a5ed77c0a6f9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.267986] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31499166-d592-4206-a00f-a5ed77c0a6f9',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.466977] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.467160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.467223] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.467433] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.467615] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.467764] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.467871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.467935] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.468389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.468389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.468389] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 already deleted. [ 615.468591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.737998] env[68109]: INFO networking_nsxv3.common.synchronization [None req-e1fd99d1-82c9-421d-af78-a8e6930945dd None None] Enqueued Resource ID: 1c3df9bc-838a-467d-a443-c90ac323de73 with Priority: HIGHEST for action port [ 615.737998] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c3df9bc-838a-467d-a443-c90ac323de73 with Priority: HIGHEST for action port [ 615.737998] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c3df9bc-838a-467d-a443-c90ac323de73 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.737998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c3df9bc-838a-467d-a443-c90ac323de73" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.738611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c3df9bc-838a-467d-a443-c90ac323de73" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.740218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c3df9bc-838a-467d-a443-c90ac323de73" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.740218] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c3df9bc-838a-467d-a443-c90ac323de73',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.770958] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31499166-d592-4206-a00f-a5ed77c0a6f9 [ 615.771296] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.771438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.771508] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.771867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.771963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.772071] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31499166-d592-4206-a00f-a5ed77c0a6f9 already deleted. [ 615.772152] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31499166-d592-4206-a00f-a5ed77c0a6f9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.243140] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c3df9bc-838a-467d-a443-c90ac323de73 [ 616.243456] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.243620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.243688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.243922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.244054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.244175] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c3df9bc-838a-467d-a443-c90ac323de73 already deleted. [ 616.244262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c3df9bc-838a-467d-a443-c90ac323de73" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.535270] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.535270] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.535270] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.535788] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.535788] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.535978] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.536077] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.536291] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.536432] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.536713] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 616.536930] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.536962] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.537356] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.537356] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 616.537446] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.537657] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.556451] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.556648] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 616.556904] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.556993] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.557283] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-8d07fb22-8a05-4fcd-a8b1-90faa7afb469 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.557458] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-8d07fb22-8a05-4fcd-a8b1-90faa7afb469" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.557582] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-8d07fb22-8a05-4fcd-a8b1-90faa7afb469" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.557889] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-8d07fb22-8a05-4fcd-a8b1-90faa7afb469" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.558339] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d07fb22-8a05-4fcd-a8b1-90faa7afb469',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.008954] env[68109]: INFO networking_nsxv3.common.synchronization [req-48157405-c233-4a57-8d84-f07e95424a24 req-72f5c28f-be68-4fbe-b253-c7b85866c989 tempest-ImagesOneServerTestJSON-164379074 tempest-ImagesOneServerTestJSON-164379074-project-member] Enqueued Resource ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac with Priority: HIGHEST for action security_group_members [ 617.008954] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac with Priority: HIGHEST for action security_group_members [ 617.009216] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.009325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.009325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.009901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.009901] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.009901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.010117] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.010341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.010521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.010831] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.064422] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.064422] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.064422] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.064422] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.064422] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.064422] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 8d07fb22-8a05-4fcd-a8b1-90faa7afb469 not found, creating... [ 617.064422] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.064422] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.064422] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.064422] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.064422] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.064815] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.064815] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.064815] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.065480] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.066054] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.067230] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 8d07fb22-8a05-4fcd-a8b1-90faa7afb469 is going to be created. [ 617.093777] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.094037] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.094252] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.094540] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.094960] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.095136] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-8d07fb22-8a05-4fcd-a8b1-90faa7afb469" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.517168] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.517446] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.517446] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.517615] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.517706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.517902] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.517997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.518069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.518222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.518296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.518388] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac already deleted. [ 617.518466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.786585] env[68109]: INFO networking_nsxv3.common.synchronization [None req-086ddb76-c0cb-40e4-8ad7-00cd03a7867e None None] Enqueued Resource ID: 480ffcd2-1a1b-4176-9668-8a3924a7d613 with Priority: HIGHEST for action port [ 617.786701] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 480ffcd2-1a1b-4176-9668-8a3924a7d613 with Priority: HIGHEST for action port [ 617.787258] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-480ffcd2-1a1b-4176-9668-8a3924a7d613 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.787401] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-480ffcd2-1a1b-4176-9668-8a3924a7d613" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.787445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-480ffcd2-1a1b-4176-9668-8a3924a7d613" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.788316] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-480ffcd2-1a1b-4176-9668-8a3924a7d613" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.788316] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('480ffcd2-1a1b-4176-9668-8a3924a7d613',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.799542] env[68109]: INFO networking_nsxv3.common.synchronization [None req-da19dd85-7ce2-4094-960a-65556dcda59d None None] Enqueued Resource ID: c7b546b5-4943-43b3-8e9d-7edb34d69bc9 with Priority: HIGHEST for action port [ 617.799785] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7b546b5-4943-43b3-8e9d-7edb34d69bc9 with Priority: HIGHEST for action port [ 617.800501] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7b546b5-4943-43b3-8e9d-7edb34d69bc9 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.800501] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7b546b5-4943-43b3-8e9d-7edb34d69bc9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.800845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7b546b5-4943-43b3-8e9d-7edb34d69bc9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.800845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7b546b5-4943-43b3-8e9d-7edb34d69bc9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.801165] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7b546b5-4943-43b3-8e9d-7edb34d69bc9',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.293402] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 480ffcd2-1a1b-4176-9668-8a3924a7d613 [ 618.293718] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.294373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.297240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.297392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.297490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.297595] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:480ffcd2-1a1b-4176-9668-8a3924a7d613 already deleted. [ 618.297681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-480ffcd2-1a1b-4176-9668-8a3924a7d613" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.305171] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7b546b5-4943-43b3-8e9d-7edb34d69bc9 [ 618.305431] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.305601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.306323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.306586] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.306878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.306878] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7b546b5-4943-43b3-8e9d-7edb34d69bc9 already deleted. [ 618.306878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7b546b5-4943-43b3-8e9d-7edb34d69bc9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.346622] env[68109]: INFO networking_nsxv3.common.synchronization [None req-35be4077-8cd8-4bea-b39f-8ae0edef97c0 None None] Enqueued Resource ID: cabe7f45-a79c-4085-ae38-d71cadd793c7 with Priority: HIGHEST for action port [ 618.346759] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cabe7f45-a79c-4085-ae38-d71cadd793c7 with Priority: HIGHEST for action port [ 618.347483] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-cabe7f45-a79c-4085-ae38-d71cadd793c7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.347483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cabe7f45-a79c-4085-ae38-d71cadd793c7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.347579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cabe7f45-a79c-4085-ae38-d71cadd793c7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.347980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cabe7f45-a79c-4085-ae38-d71cadd793c7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.348263] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cabe7f45-a79c-4085-ae38-d71cadd793c7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.743482] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-410 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.743482] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-410" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.743482] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-410" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.743891] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-410" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.744159] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.744309] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.744431] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.744644] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.744790] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.745443] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 618.745443] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.745555] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.745655] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.745821] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 618.745941] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.746085] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.763974] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.763974] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 618.763974] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.764771] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-410" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.764771] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-f86d133e-c776-43d1-a80b-42ccdcc3ad6e taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.764771] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-f86d133e-c776-43d1-a80b-42ccdcc3ad6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.764771] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-f86d133e-c776-43d1-a80b-42ccdcc3ad6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.766245] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-f86d133e-c776-43d1-a80b-42ccdcc3ad6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.766245] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f86d133e-c776-43d1-a80b-42ccdcc3ad6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.853160] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cabe7f45-a79c-4085-ae38-d71cadd793c7 [ 618.853160] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.853160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.853160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.853160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.853160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.853383] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cabe7f45-a79c-4085-ae38-d71cadd793c7 already deleted. [ 618.853491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cabe7f45-a79c-4085-ae38-d71cadd793c7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.160101] env[68109]: INFO networking_nsxv3.common.synchronization [req-34659853-2b63-4d4e-9a40-8390138b2585 req-20d14756-356f-412c-a27d-3a49ad4effd9 service nova] Enqueued Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_rules [ 619.160259] env[68109]: INFO networking_nsxv3.common.synchronization [req-34659853-2b63-4d4e-9a40-8390138b2585 req-20d14756-356f-412c-a27d-3a49ad4effd9 service nova] Enqueued Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_members [ 619.160449] env[68109]: INFO networking_nsxv3.common.synchronization [req-34659853-2b63-4d4e-9a40-8390138b2585 req-20d14756-356f-412c-a27d-3a49ad4effd9 service nova] Enqueued Resource ID: 8d07fb22-8a05-4fcd-a8b1-90faa7afb469 with Priority: HIGHEST for action port [ 619.160617] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_rules [ 619.160746] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_members [ 619.160838] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d07fb22-8a05-4fcd-a8b1-90faa7afb469 with Priority: HIGHEST for action port [ 619.161410] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.161816] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.161816] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.161995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.161995] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.164130] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.164267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.165157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.165157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.165157] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.165874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.165874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.166088] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.166154] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.166255] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.167638] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d07fb22-8a05-4fcd-a8b1-90faa7afb469 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.170450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d07fb22-8a05-4fcd-a8b1-90faa7afb469" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.170450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d07fb22-8a05-4fcd-a8b1-90faa7afb469" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.170450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d07fb22-8a05-4fcd-a8b1-90faa7afb469" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.170450] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d07fb22-8a05-4fcd-a8b1-90faa7afb469',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.269148] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.271257] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.271257] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.271257] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.271257] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.271257] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port f86d133e-c776-43d1-a80b-42ccdcc3ad6e not found, creating... [ 619.271446] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.271608] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.271728] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.272121] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.282018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.282018] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.282018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.282018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.282018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.282018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.282018] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: f86d133e-c776-43d1-a80b-42ccdcc3ad6e is going to be created. [ 619.302529] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.302529] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.302529] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.302529] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.302529] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.302529] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-f86d133e-c776-43d1-a80b-42ccdcc3ad6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.671737] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.671890] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.690325] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.694229] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d07fb22-8a05-4fcd-a8b1-90faa7afb469 with status ACTIVE [ 619.695428] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.695428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.695428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.695428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.695428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.695428] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.695428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.695428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.695428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.696081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.698644] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.698822] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.699728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.699997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.700092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.700139] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d07fb22-8a05-4fcd-a8b1-90faa7afb469 is going to be updated. [ 619.721527] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.721900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.721900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.721900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.722026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.722185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d07fb22-8a05-4fcd-a8b1-90faa7afb469" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.203026] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.357878] env[68109]: INFO networking_nsxv3.common.synchronization [None req-1eb22c2c-e677-43b9-a541-8d6eeba6a954 None None] Enqueued Resource ID: 1de1e102-f9b7-471f-8c39-0eeea690d8cb with Priority: HIGHEST for action port [ 620.358159] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de1e102-f9b7-471f-8c39-0eeea690d8cb with Priority: HIGHEST for action port [ 620.358922] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-1de1e102-f9b7-471f-8c39-0eeea690d8cb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.358922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1de1e102-f9b7-471f-8c39-0eeea690d8cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.358922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1de1e102-f9b7-471f-8c39-0eeea690d8cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.360800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1de1e102-f9b7-471f-8c39-0eeea690d8cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.360935] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1de1e102-f9b7-471f-8c39-0eeea690d8cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.707312] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.708146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.708146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.708146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.708146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.708146] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 is going to be created. [ 620.741055] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.741215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.741425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.741607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.741653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.753125] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 in Status: UNINITIALIZED for 2s [ 620.862788] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1de1e102-f9b7-471f-8c39-0eeea690d8cb [ 620.863250] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.863250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.863250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.863413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.865029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.865029] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1de1e102-f9b7-471f-8c39-0eeea690d8cb already deleted. [ 620.865029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1de1e102-f9b7-471f-8c39-0eeea690d8cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.970497] env[68109]: INFO networking_nsxv3.common.synchronization [None req-c5896406-e7ff-401a-b9b9-006d5051c13c None None] Enqueued Resource ID: 6625fd9b-8b44-44ac-90c0-14e3548b5324 with Priority: HIGHEST for action port [ 620.970497] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6625fd9b-8b44-44ac-90c0-14e3548b5324 with Priority: HIGHEST for action port [ 620.970930] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-6625fd9b-8b44-44ac-90c0-14e3548b5324 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.971090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6625fd9b-8b44-44ac-90c0-14e3548b5324" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.971133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6625fd9b-8b44-44ac-90c0-14e3548b5324" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.971380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6625fd9b-8b44-44ac-90c0-14e3548b5324" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.971462] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6625fd9b-8b44-44ac-90c0-14e3548b5324',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.417753] env[68109]: INFO networking_nsxv3.common.synchronization [req-48157405-c233-4a57-8d84-f07e95424a24 req-dbdefdaf-1dc8-4435-9275-88ebe008c74a service nova] Enqueued Resource ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac with Priority: HIGHEST for action security_group_rules [ 621.417753] env[68109]: INFO networking_nsxv3.common.synchronization [req-48157405-c233-4a57-8d84-f07e95424a24 req-dbdefdaf-1dc8-4435-9275-88ebe008c74a service nova] Enqueued Resource ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac with Priority: HIGHEST for action security_group_members [ 621.417753] env[68109]: INFO networking_nsxv3.common.synchronization [req-48157405-c233-4a57-8d84-f07e95424a24 req-dbdefdaf-1dc8-4435-9275-88ebe008c74a service nova] Enqueued Resource ID: f86d133e-c776-43d1-a80b-42ccdcc3ad6e with Priority: HIGHEST for action port [ 621.419348] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac with Priority: HIGHEST for action security_group_rules [ 621.419648] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac with Priority: HIGHEST for action security_group_members [ 621.419839] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f86d133e-c776-43d1-a80b-42ccdcc3ad6e with Priority: HIGHEST for action port [ 621.420923] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.420923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.420923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.422760] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.422760] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.423725] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.423875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.423938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.424220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.424384] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.424547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.424609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.424726] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.424887] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.424932] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.426242] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f86d133e-c776-43d1-a80b-42ccdcc3ad6e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.426415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f86d133e-c776-43d1-a80b-42ccdcc3ad6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.426415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f86d133e-c776-43d1-a80b-42ccdcc3ad6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.426609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f86d133e-c776-43d1-a80b-42ccdcc3ad6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.426660] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f86d133e-c776-43d1-a80b-42ccdcc3ad6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.473546] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6625fd9b-8b44-44ac-90c0-14e3548b5324 [ 621.473831] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.473975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.474067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.474361] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.474468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.474581] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6625fd9b-8b44-44ac-90c0-14e3548b5324 already deleted. [ 621.474671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6625fd9b-8b44-44ac-90c0-14e3548b5324" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.691137] env[68109]: INFO networking_nsxv3.common.synchronization [req-eab33d88-d70a-4e17-8620-97fcb96488b2 req-b1a1be73-d9df-4818-ac3a-4ca13a3aca89 tempest-DeleteServersTestJSON-2063667557 tempest-DeleteServersTestJSON-2063667557-project-member] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 621.691652] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 621.692414] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.692556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.692675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.693014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.693225] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.693374] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.693483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.693703] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.693962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.693962] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.928988] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.929173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.929597] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.931149] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f86d133e-c776-43d1-a80b-42ccdcc3ad6e with status ACTIVE [ 621.931578] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.931907] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.931907] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.932108] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.932478] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.932740] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.932865] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.932937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.933359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.933514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.933685] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.933805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.933855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.934033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.934150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.934271] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f86d133e-c776-43d1-a80b-42ccdcc3ad6e is going to be updated. [ 621.955548] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.955548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.955548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.955548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.955548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.955548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f86d133e-c776-43d1-a80b-42ccdcc3ad6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.196016] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.196912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.196912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.196912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.196912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.196912] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.196912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.196912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.197259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.197259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.197259] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 already deleted. [ 622.197359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.370207] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-505 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.370437] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.371134] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.371134] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.374216] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.374216] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.374216] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.374216] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.374216] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.374471] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 622.374471] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.374588] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.374716] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.374757] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 622.374859] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.375536] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.392186] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.392854] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 622.396016] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.396016] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.396016] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-b942504c-7cb8-4864-98cf-170fcf6c2587 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.396016] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-b942504c-7cb8-4864-98cf-170fcf6c2587" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.396016] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-b942504c-7cb8-4864-98cf-170fcf6c2587" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.396016] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-b942504c-7cb8-4864-98cf-170fcf6c2587" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.396016] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b942504c-7cb8-4864-98cf-170fcf6c2587',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.432425] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.446019] env[68109]: INFO networking_nsxv3.common.synchronization [None req-65f21d9c-f084-497d-87b4-52030ab8f279 None None] Enqueued Resource ID: eae538a5-d861-4884-9649-e893d48aebe2 with Priority: HIGHEST for action port [ 622.446019] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eae538a5-d861-4884-9649-e893d48aebe2 with Priority: HIGHEST for action port [ 622.453526] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-eae538a5-d861-4884-9649-e893d48aebe2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.453526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eae538a5-d861-4884-9649-e893d48aebe2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.453526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eae538a5-d861-4884-9649-e893d48aebe2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.453526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eae538a5-d861-4884-9649-e893d48aebe2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.453526] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eae538a5-d861-4884-9649-e893d48aebe2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.453526] env[68109]: INFO networking_nsxv3.common.synchronization [None req-2b6edcd3-cc96-4746-8b20-44af9392996b None None] Enqueued Resource ID: 3ad652a4-c9d3-45dd-86ca-5b26b1e48544 with Priority: HIGHEST for action port [ 622.454690] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ad652a4-c9d3-45dd-86ca-5b26b1e48544 with Priority: HIGHEST for action port [ 622.454690] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ad652a4-c9d3-45dd-86ca-5b26b1e48544 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.454690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ad652a4-c9d3-45dd-86ca-5b26b1e48544" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.454690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ad652a4-c9d3-45dd-86ca-5b26b1e48544" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.454690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ad652a4-c9d3-45dd-86ca-5b26b1e48544" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.454690] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ad652a4-c9d3-45dd-86ca-5b26b1e48544',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.764492] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 in Status: SUCCESS [ 622.764492] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.764912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.764912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.765109] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.765230] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.765305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.765456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.765530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.765612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.765699] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.899944] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.900243] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.900373] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.900665] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.900814] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.900978] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port b942504c-7cb8-4864-98cf-170fcf6c2587 not found, creating... [ 622.901264] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.901425] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.901984] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.904952] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.904952] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.904952] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.904952] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.904952] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.904952] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.904952] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.904952] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: b942504c-7cb8-4864-98cf-170fcf6c2587 is going to be created. [ 622.924379] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.925880] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.925880] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.925880] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.925880] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.926318] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-b942504c-7cb8-4864-98cf-170fcf6c2587" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.936880] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.937073] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.937147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.937362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.937451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.937639] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac is going to be created. [ 622.956471] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eae538a5-d861-4884-9649-e893d48aebe2 [ 622.956758] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.956874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.956917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.957119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.957208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.957303] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eae538a5-d861-4884-9649-e893d48aebe2 already deleted. [ 622.957380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eae538a5-d861-4884-9649-e893d48aebe2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.957571] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ad652a4-c9d3-45dd-86ca-5b26b1e48544 [ 622.957716] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.957830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.957944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.958153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.958487] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.958487] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ad652a4-c9d3-45dd-86ca-5b26b1e48544 already deleted. [ 622.958487] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ad652a4-c9d3-45dd-86ca-5b26b1e48544" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.959414] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.959526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.959595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.959746] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.959895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.968447] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac in Status: UNINITIALIZED for 2s [ 623.272156] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.272156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.272156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.272156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.272156] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.272156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.272156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.272156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.272901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.272901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.272901] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.272901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.272901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.272901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.274705] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.274820] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.274885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.275049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.275129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.275213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.275304] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.578384] env[68109]: INFO networking_nsxv3.common.synchronization [req-0b95a84a-03de-4f18-9c4b-942a04077a91 req-02b53fc5-2f9a-43cf-8663-96101d92a55a tempest-SecurityGroupRulesTestJSON-1543358915 tempest-SecurityGroupRulesTestJSON-1543358915-project-member] Enqueued Resource ID: e2cbf9c2-d17f-412a-b573-c860e0c198bc with Priority: HIGHEST for action security_group_rules [ 623.578914] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2cbf9c2-d17f-412a-b573-c860e0c198bc with Priority: HIGHEST for action security_group_rules [ 623.579258] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2cbf9c2-d17f-412a-b573-c860e0c198bc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.579384] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2cbf9c2-d17f-412a-b573-c860e0c198bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.579518] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2cbf9c2-d17f-412a-b573-c860e0c198bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.579706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2cbf9c2-d17f-412a-b573-c860e0c198bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.579780] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2cbf9c2-d17f-412a-b573-c860e0c198bc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.701553] env[68109]: INFO networking_nsxv3.common.synchronization [None req-e90b3ccb-7c57-46e3-9d51-0ae94a5204cd None None] Enqueued Resource ID: aead5a42-6064-442c-8a39-558c43784ecb with Priority: HIGHEST for action port [ 623.701813] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aead5a42-6064-442c-8a39-558c43784ecb with Priority: HIGHEST for action port [ 623.702418] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-aead5a42-6064-442c-8a39-558c43784ecb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.702541] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aead5a42-6064-442c-8a39-558c43784ecb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.702606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aead5a42-6064-442c-8a39-558c43784ecb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.702855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aead5a42-6064-442c-8a39-558c43784ecb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.702938] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aead5a42-6064-442c-8a39-558c43784ecb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.778230] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0: rpc.has_security_group_logging(os_id): False [ 623.796254] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.796549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.796549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.796677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.796758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.796913] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.797017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.797072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.797246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.797318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.797562] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.797693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.797749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.797860] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.797930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.798206] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.798303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.798354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.798918] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.799020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.799115] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 is going to be created. [ 623.852543] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.852688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.852749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.852947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.853139] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.864855] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 in Status: IN_PROGRESS for 2s [ 624.105483] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.105683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.105816] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.106093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.106450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.106450] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2cbf9c2-d17f-412a-b573-c860e0c198bc already deleted. [ 624.106450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2cbf9c2-d17f-412a-b573-c860e0c198bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.136641] env[68109]: INFO networking_nsxv3.common.synchronization [req-148a29a8-d025-4d34-87ce-d38c3cf8e8e3 req-824943bc-56b0-47b2-b5dd-695089c4592a tempest-ServerExternalEventsTest-1705449308 tempest-ServerExternalEventsTest-1705449308-project-member] Enqueued Resource ID: e830dadd-514a-4590-801f-e2bdf550c9d4 with Priority: HIGHEST for action security_group_members [ 624.137998] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e830dadd-514a-4590-801f-e2bdf550c9d4 with Priority: HIGHEST for action security_group_members [ 624.137998] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e830dadd-514a-4590-801f-e2bdf550c9d4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.137998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.137998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.137998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.139448] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.139448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.139448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.139448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.139448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.139448] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e830dadd-514a-4590-801f-e2bdf550c9d4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.208375] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aead5a42-6064-442c-8a39-558c43784ecb [ 624.209412] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.209412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.209412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.209412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.209412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.209412] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aead5a42-6064-442c-8a39-558c43784ecb already deleted. [ 624.209412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aead5a42-6064-442c-8a39-558c43784ecb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.337628] env[68109]: INFO networking_nsxv3.common.synchronization [req-eab33d88-d70a-4e17-8620-97fcb96488b2 req-dfd3d516-de47-4b6e-bd59-097213452a7c service nova] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_rules [ 624.337859] env[68109]: INFO networking_nsxv3.common.synchronization [req-eab33d88-d70a-4e17-8620-97fcb96488b2 req-dfd3d516-de47-4b6e-bd59-097213452a7c service nova] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 624.338049] env[68109]: INFO networking_nsxv3.common.synchronization [req-eab33d88-d70a-4e17-8620-97fcb96488b2 req-dfd3d516-de47-4b6e-bd59-097213452a7c service nova] Enqueued Resource ID: b942504c-7cb8-4864-98cf-170fcf6c2587 with Priority: HIGHEST for action port [ 624.338914] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_rules [ 624.339713] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 624.339713] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b942504c-7cb8-4864-98cf-170fcf6c2587 with Priority: HIGHEST for action port [ 624.340594] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.340594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.340594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.340594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.340594] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.342543] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.342543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.342543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.342543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.342543] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.342543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.342543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.342543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.342543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.342993] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.343777] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-b942504c-7cb8-4864-98cf-170fcf6c2587 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.343777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b942504c-7cb8-4864-98cf-170fcf6c2587" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.343777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b942504c-7cb8-4864-98cf-170fcf6c2587" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.343777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b942504c-7cb8-4864-98cf-170fcf6c2587" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.343777] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b942504c-7cb8-4864-98cf-170fcf6c2587',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.641810] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.642148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.642148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.642529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.642529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.642623] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.642684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.642752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.642946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.643117] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.643162] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e830dadd-514a-4590-801f-e2bdf550c9d4 already deleted. [ 624.643235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.675172] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.675172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.675172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.675172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.675172] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.675172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.675172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.675172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.675172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.676427] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 624.676697] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 624.676925] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 624.677166] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 624.678170] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 624.678170] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 624.678170] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 624.704092] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 624.704092] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 624.704092] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 624.704254] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.704575] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-bfcc5a29-da24-4ea1-8bfb-3996515187f8 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.706593] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-bfcc5a29-da24-4ea1-8bfb-3996515187f8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.706593] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-bfcc5a29-da24-4ea1-8bfb-3996515187f8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.706593] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-bfcc5a29-da24-4ea1-8bfb-3996515187f8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.706593] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfcc5a29-da24-4ea1-8bfb-3996515187f8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.846874] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.846874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.846874] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b942504c-7cb8-4864-98cf-170fcf6c2587 with status ACTIVE [ 624.846874] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.846874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.846874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.847173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.847173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.847292] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.847390] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.847477] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.847645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.847678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.847859] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.847939] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.847988] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.848144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.848220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.848392] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b942504c-7cb8-4864-98cf-170fcf6c2587 is going to be updated. [ 624.851993] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.873159] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.873159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.873159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.873159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.873159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.873159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b942504c-7cb8-4864-98cf-170fcf6c2587" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.983580] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac in Status: SUCCESS [ 624.983580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.983580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.983580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.983580] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.983580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.983580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.983580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.983580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.983580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.983580] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.211101] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.212077] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.212941] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.212941] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.212941] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.213375] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port bfcc5a29-da24-4ea1-8bfb-3996515187f8 not found, creating... [ 625.214014] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.214181] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.215019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.215019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.215019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.216989] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.216989] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.216989] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.216989] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.216989] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.216989] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: bfcc5a29-da24-4ea1-8bfb-3996515187f8 is going to be created. [ 625.238689] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.238689] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.238689] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.238689] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.238689] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.239101] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-bfcc5a29-da24-4ea1-8bfb-3996515187f8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.353549] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.487648] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.487819] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.487819] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.490456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.490456] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.490456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.490456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.490456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.490456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.490456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.490456] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.490456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.490456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.490456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.490456] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.490456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.490456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.491266] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.491266] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.491266] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.491266] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.574400] env[68109]: INFO networking_nsxv3.common.synchronization [req-b116548f-a8c7-487a-93da-8b2256f726c0 req-7a76b27d-7876-4475-a44a-2bf504873faf tempest-ServersTestManualDisk-984063323 tempest-ServersTestManualDisk-984063323-project-member] Enqueued Resource ID: d2db7fe9-82f8-4d20-b269-363d052050b8 with Priority: HIGHEST for action security_group_members [ 625.574901] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2db7fe9-82f8-4d20-b269-363d052050b8 with Priority: HIGHEST for action security_group_members [ 625.575259] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2db7fe9-82f8-4d20-b269-363d052050b8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.575396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.575396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.577101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.577292] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.577408] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.577474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.577650] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.577737] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.577949] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2db7fe9-82f8-4d20-b269-363d052050b8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.858316] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.859989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.859989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.859989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.859989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.859989] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be created. [ 625.889682] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.889682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.889682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.889957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.889957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.893047] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 in Status: SUCCESS [ 625.893480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.901724] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: UNINITIALIZED for 2s [ 625.995136] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac: rpc.has_security_group_logging(os_id): False [ 626.020758] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.020896] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.020964] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.021204] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.021289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.021469] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.021564] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.021631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.024018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.024018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.024018] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.024018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.024018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.024018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.024018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.024018] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.024018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.024018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.024018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.024018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.024530] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac is going to be created. [ 626.085154] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.085467] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.085594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.085808] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.085905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.086140] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.086260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.086346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.086592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.086592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.086673] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2db7fe9-82f8-4d20-b269-363d052050b8 already deleted. [ 626.086706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.087871] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.087995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.088671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.088857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.089244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.101808] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac in Status: IN_PROGRESS for 2s [ 626.296048] env[68109]: INFO networking_nsxv3.common.synchronization [None req-ccab4004-05b7-4db3-b350-2a194f50366a None None] Enqueued Resource ID: 898e2381-ac6e-4dfe-a304-036c6db2a233 with Priority: HIGHEST for action port [ 626.297266] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 898e2381-ac6e-4dfe-a304-036c6db2a233 with Priority: HIGHEST for action port [ 626.297568] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-898e2381-ac6e-4dfe-a304-036c6db2a233 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.297746] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-898e2381-ac6e-4dfe-a304-036c6db2a233" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.297827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-898e2381-ac6e-4dfe-a304-036c6db2a233" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.298114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-898e2381-ac6e-4dfe-a304-036c6db2a233" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.298331] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('898e2381-ac6e-4dfe-a304-036c6db2a233',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.492047] env[68109]: INFO networking_nsxv3.common.synchronization [req-148a29a8-d025-4d34-87ce-d38c3cf8e8e3 req-7381f586-8519-4631-b468-f13cee23f9b4 service nova] Enqueued Resource ID: e830dadd-514a-4590-801f-e2bdf550c9d4 with Priority: HIGHEST for action security_group_rules [ 626.492357] env[68109]: INFO networking_nsxv3.common.synchronization [req-148a29a8-d025-4d34-87ce-d38c3cf8e8e3 req-7381f586-8519-4631-b468-f13cee23f9b4 service nova] Enqueued Resource ID: e830dadd-514a-4590-801f-e2bdf550c9d4 with Priority: HIGHEST for action security_group_members [ 626.492455] env[68109]: INFO networking_nsxv3.common.synchronization [req-148a29a8-d025-4d34-87ce-d38c3cf8e8e3 req-7381f586-8519-4631-b468-f13cee23f9b4 service nova] Enqueued Resource ID: bfcc5a29-da24-4ea1-8bfb-3996515187f8 with Priority: HIGHEST for action port [ 626.492993] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e830dadd-514a-4590-801f-e2bdf550c9d4 with Priority: HIGHEST for action security_group_rules [ 626.493916] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e830dadd-514a-4590-801f-e2bdf550c9d4 with Priority: HIGHEST for action security_group_members [ 626.493958] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfcc5a29-da24-4ea1-8bfb-3996515187f8 with Priority: HIGHEST for action port [ 626.494246] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e830dadd-514a-4590-801f-e2bdf550c9d4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.494719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.494797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.495081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.495178] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e830dadd-514a-4590-801f-e2bdf550c9d4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.496662] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e830dadd-514a-4590-801f-e2bdf550c9d4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.496787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.496861] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.497076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.497301] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.497407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.497469] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.497651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.497739] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.497829] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e830dadd-514a-4590-801f-e2bdf550c9d4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.500187] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfcc5a29-da24-4ea1-8bfb-3996515187f8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.500187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfcc5a29-da24-4ea1-8bfb-3996515187f8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.500187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfcc5a29-da24-4ea1-8bfb-3996515187f8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.500187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfcc5a29-da24-4ea1-8bfb-3996515187f8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.500187] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfcc5a29-da24-4ea1-8bfb-3996515187f8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.502827] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.503035] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-985" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.504995] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-985" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.504995] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-985" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.504995] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.504995] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.504995] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.504995] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.504995] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.504995] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 626.504995] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.504995] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.504995] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.505400] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 626.505400] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.505547] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.525281] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.525452] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 626.526351] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.526351] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-985" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.526351] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-023c642e-2d78-4760-b3ec-50b837d6fcbb taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.526351] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-023c642e-2d78-4760-b3ec-50b837d6fcbb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.526351] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-023c642e-2d78-4760-b3ec-50b837d6fcbb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.526681] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-023c642e-2d78-4760-b3ec-50b837d6fcbb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.526811] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('023c642e-2d78-4760-b3ec-50b837d6fcbb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.800959] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 898e2381-ac6e-4dfe-a304-036c6db2a233 [ 626.801228] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.801368] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.801436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.801655] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.801748] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.801843] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:898e2381-ac6e-4dfe-a304-036c6db2a233 already deleted. [ 626.801948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-898e2381-ac6e-4dfe-a304-036c6db2a233" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.003587] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e830dadd-514a-4590-801f-e2bdf550c9d4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.004961] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e830dadd-514a-4590-801f-e2bdf550c9d4 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.005349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.005349] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfcc5a29-da24-4ea1-8bfb-3996515187f8 with status ACTIVE [ 627.005787] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.007062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.007062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.007062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.007062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.008038] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.008038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.008038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.008672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.008672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.008672] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.008672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.008672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.008982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.008982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.008982] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfcc5a29-da24-4ea1-8bfb-3996515187f8 is going to be updated. [ 627.029217] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.029574] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.029574] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.029690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.029838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.030085] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfcc5a29-da24-4ea1-8bfb-3996515187f8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.030481] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.030705] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.030998] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.030998] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.032441] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.033113] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 023c642e-2d78-4760-b3ec-50b837d6fcbb not found, creating... [ 627.036023] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.036023] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.036023] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.036023] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.036023] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.036023] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.036023] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.036023] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.036023] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.038243] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.039484] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 023c642e-2d78-4760-b3ec-50b837d6fcbb is going to be created. [ 627.063301] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.063926] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.063926] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.064011] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.064273] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.064503] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-023c642e-2d78-4760-b3ec-50b837d6fcbb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.095018] env[68109]: INFO networking_nsxv3.common.synchronization [None req-189ab6b7-e14c-449c-a487-83d899f5eaf0 None None] Enqueued Resource ID: dde4c41a-90d9-4f82-b515-5374f8079e29 with Priority: HIGHEST for action port [ 627.095018] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dde4c41a-90d9-4f82-b515-5374f8079e29 with Priority: HIGHEST for action port [ 627.095018] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-dde4c41a-90d9-4f82-b515-5374f8079e29 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.095018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dde4c41a-90d9-4f82-b515-5374f8079e29" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.095018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dde4c41a-90d9-4f82-b515-5374f8079e29" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.095018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dde4c41a-90d9-4f82-b515-5374f8079e29" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.095018] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde4c41a-90d9-4f82-b515-5374f8079e29',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.154650] env[68109]: INFO networking_nsxv3.common.synchronization [req-3e482b40-3157-485e-9a0e-b074937d26f1 req-145f7c77-c12d-456f-8fda-8070b8f3d855 tempest-SecurityGroupRulesTestJSON-1543358915 tempest-SecurityGroupRulesTestJSON-1543358915-project-member] Enqueued Resource ID: 093ef8c4-8818-40e3-8d5c-86761734deca with Priority: HIGHEST for action security_group_rules [ 627.154849] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093ef8c4-8818-40e3-8d5c-86761734deca with Priority: HIGHEST for action security_group_rules [ 627.155018] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-093ef8c4-8818-40e3-8d5c-86761734deca taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.156291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-093ef8c4-8818-40e3-8d5c-86761734deca" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.156291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-093ef8c4-8818-40e3-8d5c-86761734deca" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.156396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-093ef8c4-8818-40e3-8d5c-86761734deca" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.156514] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('093ef8c4-8818-40e3-8d5c-86761734deca',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.511358] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e830dadd-514a-4590-801f-e2bdf550c9d4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.598396] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dde4c41a-90d9-4f82-b515-5374f8079e29 [ 627.599742] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.599742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.599742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.599742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.599742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.599742] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dde4c41a-90d9-4f82-b515-5374f8079e29 already deleted. [ 627.599742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dde4c41a-90d9-4f82-b515-5374f8079e29" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.677374] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.677374] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.678186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.678597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.678773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.678948] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 093ef8c4-8818-40e3-8d5c-86761734deca already deleted. [ 627.679140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-093ef8c4-8818-40e3-8d5c-86761734deca" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.915825] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 627.916065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.916365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.916451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.916646] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.916771] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.916844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.917165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.917165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.917275] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.917275] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.015169] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.015588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.015588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.015588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.015588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.015912] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e830dadd-514a-4590-801f-e2bdf550c9d4 is going to be created. [ 628.037025] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.037202] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.037277] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.037531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.037708] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.050851] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e830dadd-514a-4590-801f-e2bdf550c9d4 in Status: UNINITIALIZED for 2s [ 628.114299] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac in Status: SUCCESS [ 628.114582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.370631] env[68109]: INFO networking_nsxv3.common.synchronization [None req-c0ec4892-7630-40e1-a88d-fa3725cda2a0 None None] Enqueued Resource ID: 4a724aea-c586-4224-a28a-547d135f6873 with Priority: HIGHEST for action port [ 628.371262] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a724aea-c586-4224-a28a-547d135f6873 with Priority: HIGHEST for action port [ 628.371641] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a724aea-c586-4224-a28a-547d135f6873 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.371880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a724aea-c586-4224-a28a-547d135f6873" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.371880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a724aea-c586-4224-a28a-547d135f6873" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.372386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a724aea-c586-4224-a28a-547d135f6873" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.372386] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a724aea-c586-4224-a28a-547d135f6873',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.419970] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.420143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.420211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.420900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.421120] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.421232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.421333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.421474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.421558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.421679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.421833] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.422135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.422212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.422377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.422520] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.422615] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.422684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.422829] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.422913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.426051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.426051] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.545990] env[68109]: INFO networking_nsxv3.common.synchronization [req-deb57357-8457-4663-a255-57e1c7ddf883 req-3ea18c2e-d4f1-479d-aa55-189602e37c3e tempest-ServerDiagnosticsNegativeTest-305206900 tempest-ServerDiagnosticsNegativeTest-305206900-project-member] Enqueued Resource ID: 884a937d-f25c-4b98-be12-acfbdb273d70 with Priority: HIGHEST for action security_group_members [ 628.546573] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884a937d-f25c-4b98-be12-acfbdb273d70 with Priority: HIGHEST for action security_group_members [ 628.546987] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-884a937d-f25c-4b98-be12-acfbdb273d70 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.546987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.547138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.547309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.547463] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.547562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.547622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.547767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.547844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.551924] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('884a937d-f25c-4b98-be12-acfbdb273d70',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.652146] env[68109]: INFO networking_nsxv3.common.synchronization [req-b116548f-a8c7-487a-93da-8b2256f726c0 req-16f48ca5-cf41-4496-93cb-2568b3912a9c service nova] Enqueued Resource ID: d2db7fe9-82f8-4d20-b269-363d052050b8 with Priority: HIGHEST for action security_group_rules [ 628.652146] env[68109]: INFO networking_nsxv3.common.synchronization [req-b116548f-a8c7-487a-93da-8b2256f726c0 req-16f48ca5-cf41-4496-93cb-2568b3912a9c service nova] Enqueued Resource ID: d2db7fe9-82f8-4d20-b269-363d052050b8 with Priority: HIGHEST for action security_group_members [ 628.652146] env[68109]: INFO networking_nsxv3.common.synchronization [req-b116548f-a8c7-487a-93da-8b2256f726c0 req-16f48ca5-cf41-4496-93cb-2568b3912a9c service nova] Enqueued Resource ID: 023c642e-2d78-4760-b3ec-50b837d6fcbb with Priority: HIGHEST for action port [ 628.652146] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2db7fe9-82f8-4d20-b269-363d052050b8 with Priority: HIGHEST for action security_group_rules [ 628.652146] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2db7fe9-82f8-4d20-b269-363d052050b8 with Priority: HIGHEST for action security_group_members [ 628.652146] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023c642e-2d78-4760-b3ec-50b837d6fcbb with Priority: HIGHEST for action port [ 628.652146] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2db7fe9-82f8-4d20-b269-363d052050b8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.652146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.652146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.652146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.652146] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2db7fe9-82f8-4d20-b269-363d052050b8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.654757] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2db7fe9-82f8-4d20-b269-363d052050b8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.656024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.656024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.656024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.656024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.656024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.656024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.656024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.656024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.656024] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2db7fe9-82f8-4d20-b269-363d052050b8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.659608] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-023c642e-2d78-4760-b3ec-50b837d6fcbb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.659879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-023c642e-2d78-4760-b3ec-50b837d6fcbb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.661181] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-023c642e-2d78-4760-b3ec-50b837d6fcbb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.661181] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-023c642e-2d78-4760-b3ec-50b837d6fcbb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.661181] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('023c642e-2d78-4760-b3ec-50b837d6fcbb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.876026] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a724aea-c586-4224-a28a-547d135f6873 [ 628.876026] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.876026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.876026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.876351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.876351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.876417] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a724aea-c586-4224-a28a-547d135f6873 already deleted. [ 628.876472] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a724aea-c586-4224-a28a-547d135f6873" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.927072] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3775fbff-3109-41e9-a7b4-71b12133d9f0: rpc.has_security_group_logging(os_id): False [ 628.950026] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.950026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.950026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.950026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.950026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.950026] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.950026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.950026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.950026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.950026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.950026] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.950026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.950026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.950026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.950026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.950709] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.950709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.950709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.950709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.950709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.950709] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be created. [ 629.006120] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.006414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.006569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.006729] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.006916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.018317] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 629.055981] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.056443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.056524] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.056793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.056891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.057235] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.057235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.057363] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.057568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.057628] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.057716] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 884a937d-f25c-4b98-be12-acfbdb273d70 already deleted. [ 629.057801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.155290] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2db7fe9-82f8-4d20-b269-363d052050b8 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.155487] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.159909] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2db7fe9-82f8-4d20-b269-363d052050b8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.163107] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 023c642e-2d78-4760-b3ec-50b837d6fcbb with status ACTIVE [ 629.163840] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.163840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.163840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.163840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.164065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.164313] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.164362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.164393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.164730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.164730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.164821] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.164883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.164948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.165120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.165199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.165287] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 023c642e-2d78-4760-b3ec-50b837d6fcbb is going to be updated. [ 629.201991] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.202228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.202329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.202548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.202684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.202840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-023c642e-2d78-4760-b3ec-50b837d6fcbb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.550299] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.550299] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.550299] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.550299] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.550299] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.550299] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.550299] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.550299] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.550299] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.550299] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 629.550299] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.550299] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.550299] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.550868] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 629.550868] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.550868] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.575778] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.576043] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 629.576185] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.576362] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.576675] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-1f3ed2db-508b-47d5-af89-68709df2b961 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.576842] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-1f3ed2db-508b-47d5-af89-68709df2b961" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.576968] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-1f3ed2db-508b-47d5-af89-68709df2b961" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.577323] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-1f3ed2db-508b-47d5-af89-68709df2b961" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.577528] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f3ed2db-508b-47d5-af89-68709df2b961',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.662649] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2db7fe9-82f8-4d20-b269-363d052050b8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.060981] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e830dadd-514a-4590-801f-e2bdf550c9d4 in Status: SUCCESS [ 630.061285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.061505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.061597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.061758] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.062420] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.062420] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.062420] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.062420] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.062420] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.062420] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e830dadd-514a-4590-801f-e2bdf550c9d4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.080650] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.083769] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.083769] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.083769] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.083769] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.083769] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 1f3ed2db-508b-47d5-af89-68709df2b961 not found, creating... [ 630.083769] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.083769] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.083769] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.083769] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.083769] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.084299] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.084299] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.084299] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.084762] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.085406] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.085894] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 1f3ed2db-508b-47d5-af89-68709df2b961 is going to be created. [ 630.104289] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.104522] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.104650] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.104921] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.105272] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.105380] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-1f3ed2db-508b-47d5-af89-68709df2b961" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.169347] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.169347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.169347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.169347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.169347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.169347] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2db7fe9-82f8-4d20-b269-363d052050b8 is going to be created. [ 630.205573] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.205573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.205573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.205573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.205573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.215359] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2db7fe9-82f8-4d20-b269-363d052050b8 in Status: UNINITIALIZED for 2s [ 630.565891] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e830dadd-514a-4590-801f-e2bdf550c9d4 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.566081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.566135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.566358] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.566519] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.567088] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.567259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.567299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.567394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.567549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.567639] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e830dadd-514a-4590-801f-e2bdf550c9d4 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.567733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.567792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.567939] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.568324] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.568483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.568483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.568644] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.568698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.568804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.569387] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e830dadd-514a-4590-801f-e2bdf550c9d4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.658725] env[68109]: INFO networking_nsxv3.common.synchronization [None req-095830df-8666-4487-8819-0dc406a4ed87 None None] Enqueued Resource ID: 2ba58b7d-ba75-4fd3-891d-29318686e6f7 with Priority: HIGHEST for action port [ 630.658725] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ba58b7d-ba75-4fd3-891d-29318686e6f7 with Priority: HIGHEST for action port [ 630.658725] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ba58b7d-ba75-4fd3-891d-29318686e6f7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.658725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ba58b7d-ba75-4fd3-891d-29318686e6f7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.659010] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ba58b7d-ba75-4fd3-891d-29318686e6f7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.659607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ba58b7d-ba75-4fd3-891d-29318686e6f7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.659825] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ba58b7d-ba75-4fd3-891d-29318686e6f7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.003031] env[68109]: INFO networking_nsxv3.common.synchronization [None req-c656847f-4375-405a-90b6-a13c10d23f6d tempest-VolumesAssistedSnapshotsTest-142452177 tempest-VolumesAssistedSnapshotsTest-142452177-project-member] Enqueued Resource ID: 80fea482-6d64-4937-892c-62371db01817 with Priority: HIGHEST for action security_group_rules [ 631.003999] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80fea482-6d64-4937-892c-62371db01817 with Priority: HIGHEST for action security_group_rules [ 631.004880] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80fea482-6d64-4937-892c-62371db01817 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.004880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.004880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.005336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.005481] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80fea482-6d64-4937-892c-62371db01817',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.033877] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 631.035365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.072558] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e830dadd-514a-4590-801f-e2bdf550c9d4: rpc.has_security_group_logging(os_id): False [ 631.092210] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.096197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.096197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.096197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.096197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.096197] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.096197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.096197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.096197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.096197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.096197] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.096197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.096197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.096197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.097156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.097379] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.097482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.097545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.097718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.097805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.097885] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e830dadd-514a-4590-801f-e2bdf550c9d4 is going to be created. [ 631.156468] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.156578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.156776] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.156844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.157026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.162021] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ba58b7d-ba75-4fd3-891d-29318686e6f7 [ 631.162382] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.162382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.162504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.162634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.164859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.164859] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ba58b7d-ba75-4fd3-891d-29318686e6f7 already deleted. [ 631.164859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ba58b7d-ba75-4fd3-891d-29318686e6f7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.167175] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e830dadd-514a-4590-801f-e2bdf550c9d4 in Status: IN_PROGRESS for 2s [ 631.195513] env[68109]: INFO networking_nsxv3.common.synchronization [None req-72011ac4-09ff-4b02-bd61-ba06ddf8687c tempest-VolumesAssistedSnapshotsTest-142452177 tempest-VolumesAssistedSnapshotsTest-142452177-project-member] Enqueued Resource ID: 80fea482-6d64-4937-892c-62371db01817 with Priority: HIGHEST for action security_group_rules [ 631.196115] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80fea482-6d64-4937-892c-62371db01817 with Priority: HIGHEST for action security_group_rules [ 631.196430] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80fea482-6d64-4937-892c-62371db01817 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.196538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.524249] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.524372] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.524445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.524663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.524751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.524848] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80fea482-6d64-4937-892c-62371db01817 already deleted. [ 631.524933] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.525100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.525255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.525337] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80fea482-6d64-4937-892c-62371db01817',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.755297] env[68109]: INFO networking_nsxv3.common.synchronization [None req-db8fbe68-78de-4991-adc3-e42cf3b8f082 None None] Enqueued Resource ID: c94a6574-3b03-4fc2-ad4a-a08ed7bc6642 with Priority: HIGHEST for action port [ 631.755557] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c94a6574-3b03-4fc2-ad4a-a08ed7bc6642 with Priority: HIGHEST for action port [ 631.756725] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-c94a6574-3b03-4fc2-ad4a-a08ed7bc6642 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.756725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c94a6574-3b03-4fc2-ad4a-a08ed7bc6642" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.756725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c94a6574-3b03-4fc2-ad4a-a08ed7bc6642" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.756725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c94a6574-3b03-4fc2-ad4a-a08ed7bc6642" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.756725] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c94a6574-3b03-4fc2-ad4a-a08ed7bc6642',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.773710] env[68109]: INFO networking_nsxv3.common.synchronization [req-def6ed18-8207-41e3-b6e9-74d7bef20a5c req-d4dfdae6-2162-455a-b9fe-a2ed46f5847d tempest-FloatingIPsAssociationTestJSON-1926415346 tempest-FloatingIPsAssociationTestJSON-1926415346-project-member] Enqueued Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_members [ 631.777051] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_members [ 631.777444] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.777731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.777731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.777992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.778176] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.778292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.778359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.778545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.778649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.778747] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.836801] env[68109]: INFO networking_nsxv3.common.synchronization [req-deb57357-8457-4663-a255-57e1c7ddf883 req-25566dc7-8fb3-4592-a2ef-4900b9053a09 service nova] Enqueued Resource ID: 884a937d-f25c-4b98-be12-acfbdb273d70 with Priority: HIGHEST for action security_group_rules [ 631.837529] env[68109]: INFO networking_nsxv3.common.synchronization [req-deb57357-8457-4663-a255-57e1c7ddf883 req-25566dc7-8fb3-4592-a2ef-4900b9053a09 service nova] Enqueued Resource ID: 884a937d-f25c-4b98-be12-acfbdb273d70 with Priority: HIGHEST for action security_group_members [ 631.837628] env[68109]: INFO networking_nsxv3.common.synchronization [req-deb57357-8457-4663-a255-57e1c7ddf883 req-25566dc7-8fb3-4592-a2ef-4900b9053a09 service nova] Enqueued Resource ID: 1f3ed2db-508b-47d5-af89-68709df2b961 with Priority: HIGHEST for action port [ 631.838016] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884a937d-f25c-4b98-be12-acfbdb273d70 with Priority: HIGHEST for action security_group_rules [ 631.838861] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884a937d-f25c-4b98-be12-acfbdb273d70 with Priority: HIGHEST for action security_group_members [ 631.839013] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3ed2db-508b-47d5-af89-68709df2b961 with Priority: HIGHEST for action port [ 631.839634] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-884a937d-f25c-4b98-be12-acfbdb273d70 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.840538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.840538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.840538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.840538] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('884a937d-f25c-4b98-be12-acfbdb273d70',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.841952] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-884a937d-f25c-4b98-be12-acfbdb273d70 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.842404] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.842703] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.842916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.843293] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.843655] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.844024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.844186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.844285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.844378] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('884a937d-f25c-4b98-be12-acfbdb273d70',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.845179] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f3ed2db-508b-47d5-af89-68709df2b961 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.845284] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f3ed2db-508b-47d5-af89-68709df2b961" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.845351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f3ed2db-508b-47d5-af89-68709df2b961" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.845507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f3ed2db-508b-47d5-af89-68709df2b961" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.845577] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f3ed2db-508b-47d5-af89-68709df2b961',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.945865] env[68109]: INFO networking_nsxv3.common.synchronization [None req-2be6d575-91d5-4bdf-b965-6762d48f8c59 None None] Enqueued Resource ID: eb396817-2a0e-4af9-87a9-86c143d97fe1 with Priority: HIGHEST for action port [ 631.946133] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb396817-2a0e-4af9-87a9-86c143d97fe1 with Priority: HIGHEST for action port [ 631.946744] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb396817-2a0e-4af9-87a9-86c143d97fe1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.946987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb396817-2a0e-4af9-87a9-86c143d97fe1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.946987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb396817-2a0e-4af9-87a9-86c143d97fe1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.947190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb396817-2a0e-4af9-87a9-86c143d97fe1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.947272] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb396817-2a0e-4af9-87a9-86c143d97fe1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.044679] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.044679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.044941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.045258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.045258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.045317] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80fea482-6d64-4937-892c-62371db01817 already deleted. [ 632.045416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.224406] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2db7fe9-82f8-4d20-b269-363d052050b8 in Status: SUCCESS [ 632.225926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.225926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.225926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.225926] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.225926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.225926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.225926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.225926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.225926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.225926] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2db7fe9-82f8-4d20-b269-363d052050b8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.259324] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c94a6574-3b03-4fc2-ad4a-a08ed7bc6642 [ 632.259566] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.259733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.259827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.260035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.260127] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.260226] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c94a6574-3b03-4fc2-ad4a-a08ed7bc6642 already deleted. [ 632.260307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c94a6574-3b03-4fc2-ad4a-a08ed7bc6642" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.283656] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.283656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.283656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.283656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.283656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.285026] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.285283] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.285433] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.285676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.285923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.286165] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 already deleted. [ 632.286322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.349673] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-884a937d-f25c-4b98-be12-acfbdb273d70 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.349673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.349673] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('884a937d-f25c-4b98-be12-acfbdb273d70',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.349673] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f3ed2db-508b-47d5-af89-68709df2b961 with status ACTIVE [ 632.349673] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.349673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.349673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.349673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.349673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.349673] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.349673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.349673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.350180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.350180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.350180] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.350180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.350180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.350372] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.350372] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.350684] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f3ed2db-508b-47d5-af89-68709df2b961 is going to be updated. [ 632.373556] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.374097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.374097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.374097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.374097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.375109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f3ed2db-508b-47d5-af89-68709df2b961" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.383076] env[68109]: INFO networking_nsxv3.common.synchronization [req-e5f26ee4-7350-435a-a0d7-4a36aa04398f req-375bb7ef-26e8-4c0d-b169-f9944e17a261 tempest-SecurityGroupRulesTestJSON-1543358915 tempest-SecurityGroupRulesTestJSON-1543358915-project-member] Enqueued Resource ID: 283312f9-5936-4a65-9385-1f5062b83e6f with Priority: HIGHEST for action security_group_rules [ 632.383972] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 283312f9-5936-4a65-9385-1f5062b83e6f with Priority: HIGHEST for action security_group_rules [ 632.383972] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-283312f9-5936-4a65-9385-1f5062b83e6f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.383972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-283312f9-5936-4a65-9385-1f5062b83e6f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.387626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-283312f9-5936-4a65-9385-1f5062b83e6f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.387626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-283312f9-5936-4a65-9385-1f5062b83e6f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.387745] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('283312f9-5936-4a65-9385-1f5062b83e6f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.451122] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb396817-2a0e-4af9-87a9-86c143d97fe1 [ 632.452185] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.452552] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.452730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.453041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.453491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.453491] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb396817-2a0e-4af9-87a9-86c143d97fe1 already deleted. [ 632.453491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb396817-2a0e-4af9-87a9-86c143d97fe1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.730657] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2db7fe9-82f8-4d20-b269-363d052050b8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.853585] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('884a937d-f25c-4b98-be12-acfbdb273d70',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.915484] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.915484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.915484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.915484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.915484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.915672] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 283312f9-5936-4a65-9385-1f5062b83e6f already deleted. [ 632.915801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-283312f9-5936-4a65-9385-1f5062b83e6f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.181409] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e830dadd-514a-4590-801f-e2bdf550c9d4 in Status: SUCCESS [ 633.181409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.235020] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2db7fe9-82f8-4d20-b269-363d052050b8: rpc.has_security_group_logging(os_id): False [ 633.250310] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.250456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.250641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.250846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.250881] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.251126] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.251236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.251304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.251449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.251527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.251610] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2db7fe9-82f8-4d20-b269-363d052050b8 is going to be created. [ 633.317026] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.317172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.317378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.317604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.317791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.330075] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2db7fe9-82f8-4d20-b269-363d052050b8 in Status: IN_PROGRESS for 2s [ 633.356817] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.356899] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.356933] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.357160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.357254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.357355] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 884a937d-f25c-4b98-be12-acfbdb273d70 is going to be created. [ 633.386696] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.386806] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.386855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.387065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.387397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.401061] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-3 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.401061] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.401061] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.401061] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.401061] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.401061] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.402394] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.402394] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.402394] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.402485] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 633.402668] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.402732] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.402866] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.402925] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 633.403127] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.403217] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.409191] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884a937d-f25c-4b98-be12-acfbdb273d70 in Status: UNINITIALIZED for 2s [ 633.436055] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.436227] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 633.436396] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.436591] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.436934] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-bbf13920-3db5-4f35-a4e0-72946a3675e1 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.437098] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-bbf13920-3db5-4f35-a4e0-72946a3675e1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.437224] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-bbf13920-3db5-4f35-a4e0-72946a3675e1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.437546] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-bbf13920-3db5-4f35-a4e0-72946a3675e1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.438422] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbf13920-3db5-4f35-a4e0-72946a3675e1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.942051] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.942051] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.942051] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.942051] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.942051] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.942357] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port bbf13920-3db5-4f35-a4e0-72946a3675e1 not found, creating... [ 633.942412] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.942644] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.942714] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.942915] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.945501] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.945936] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.946334] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.946334] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.946749] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.946936] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.947341] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: bbf13920-3db5-4f35-a4e0-72946a3675e1 is going to be created. [ 633.967970] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.968261] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.968356] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.968632] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.968857] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.969156] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-bbf13920-3db5-4f35-a4e0-72946a3675e1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.367761] env[68109]: INFO networking_nsxv3.common.synchronization [None req-427e04ed-17f7-40e6-9ae1-2d0a82f8a6ba None None] Enqueued Resource ID: e733d04e-0fae-404b-82f1-8a9e80f3c7da with Priority: HIGHEST for action port [ 634.367761] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e733d04e-0fae-404b-82f1-8a9e80f3c7da with Priority: HIGHEST for action port [ 634.370626] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-e733d04e-0fae-404b-82f1-8a9e80f3c7da taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.370626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e733d04e-0fae-404b-82f1-8a9e80f3c7da" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.370626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e733d04e-0fae-404b-82f1-8a9e80f3c7da" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.370626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e733d04e-0fae-404b-82f1-8a9e80f3c7da" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.370626] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e733d04e-0fae-404b-82f1-8a9e80f3c7da',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.848525] env[68109]: INFO networking_nsxv3.common.synchronization [None req-6165a2ac-c357-4c36-a908-e49ffc3dc264 None None] Enqueued Resource ID: c9a14f25-6e6b-4cb7-aa65-f6e7bfabf91c with Priority: HIGHEST for action port [ 634.848801] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9a14f25-6e6b-4cb7-aa65-f6e7bfabf91c with Priority: HIGHEST for action port [ 634.849380] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9a14f25-6e6b-4cb7-aa65-f6e7bfabf91c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.849613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9a14f25-6e6b-4cb7-aa65-f6e7bfabf91c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.849613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9a14f25-6e6b-4cb7-aa65-f6e7bfabf91c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.849811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9a14f25-6e6b-4cb7-aa65-f6e7bfabf91c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.849904] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9a14f25-6e6b-4cb7-aa65-f6e7bfabf91c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.873612] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e733d04e-0fae-404b-82f1-8a9e80f3c7da [ 634.874972] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.875634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.875903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.875982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.876209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.876209] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e733d04e-0fae-404b-82f1-8a9e80f3c7da already deleted. [ 634.876331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e733d04e-0fae-404b-82f1-8a9e80f3c7da" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.037572] env[68109]: INFO networking_nsxv3.common.synchronization [req-b235ca15-1d0a-457a-9a33-073d2e070a2a req-374f7f39-1daa-4ccd-b0d0-a331f9fd7ca4 tempest-DeleteServersAdminTestJSON-974389429 tempest-DeleteServersAdminTestJSON-974389429-project-admin] Enqueued Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_members [ 635.040047] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_members [ 635.040328] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.040473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.040679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.040877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.041022] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.041100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.041142] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.041317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.041402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.041506] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.181398] env[68109]: INFO networking_nsxv3.common.synchronization [req-def6ed18-8207-41e3-b6e9-74d7bef20a5c req-68788b2d-3c26-4b5d-9a29-4cf4c7773fb8 service nova] Enqueued Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_rules [ 635.181398] env[68109]: INFO networking_nsxv3.common.synchronization [req-def6ed18-8207-41e3-b6e9-74d7bef20a5c req-68788b2d-3c26-4b5d-9a29-4cf4c7773fb8 service nova] Enqueued Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_members [ 635.181398] env[68109]: INFO networking_nsxv3.common.synchronization [req-def6ed18-8207-41e3-b6e9-74d7bef20a5c req-68788b2d-3c26-4b5d-9a29-4cf4c7773fb8 service nova] Enqueued Resource ID: bbf13920-3db5-4f35-a4e0-72946a3675e1 with Priority: HIGHEST for action port [ 635.181398] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_rules [ 635.181398] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_members [ 635.181398] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf13920-3db5-4f35-a4e0-72946a3675e1 with Priority: HIGHEST for action port [ 635.181638] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.181638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.181744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.182056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.182151] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.183171] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.183296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.183296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.184555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.184555] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.184555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.184555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.184555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.184555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.184555] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.185269] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbf13920-3db5-4f35-a4e0-72946a3675e1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.185383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbf13920-3db5-4f35-a4e0-72946a3675e1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.185481] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbf13920-3db5-4f35-a4e0-72946a3675e1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.187164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbf13920-3db5-4f35-a4e0-72946a3675e1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.187239] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbf13920-3db5-4f35-a4e0-72946a3675e1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.321808] env[68109]: INFO networking_nsxv3.common.synchronization [None req-206bb85c-e854-481b-b206-0a7966711b7f tempest-ServersWithSpecificFlavorTestJSON-306442882 tempest-ServersWithSpecificFlavorTestJSON-306442882-project-member] Enqueued Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_rules [ 635.321947] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_rules [ 635.322289] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.322415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.322493] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.322777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.322820] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.342378] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2db7fe9-82f8-4d20-b269-363d052050b8 in Status: SUCCESS [ 635.342536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.354391] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9a14f25-6e6b-4cb7-aa65-f6e7bfabf91c [ 635.354649] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.354787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.354857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.356070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.356176] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.356287] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9a14f25-6e6b-4cb7-aa65-f6e7bfabf91c already deleted. [ 635.356383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9a14f25-6e6b-4cb7-aa65-f6e7bfabf91c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.420211] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884a937d-f25c-4b98-be12-acfbdb273d70 in Status: SUCCESS [ 635.420499] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.420562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.421109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.421109] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.421324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.421324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.421390] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.421480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.421594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.421668] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('884a937d-f25c-4b98-be12-acfbdb273d70',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.545885] env[68109]: INFO networking_nsxv3.common.synchronization [None req-4e74108f-d31d-4179-8ae9-c8c288358b70 tempest-ServersWithSpecificFlavorTestJSON-306442882 tempest-ServersWithSpecificFlavorTestJSON-306442882-project-member] Enqueued Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_rules [ 635.546513] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.546700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.546700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.546944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.546944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.547126] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.547736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.547736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.547736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.547736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.547736] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 is going to be updated. [ 635.551209] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_rules [ 635.551433] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.551532] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.580334] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.580334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.580334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.580630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.580630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.590327] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 in Status: IN_PROGRESS for 2s [ 635.691047] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.691047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.691047] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.691047] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbf13920-3db5-4f35-a4e0-72946a3675e1 with status ACTIVE [ 635.691047] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.691521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.691521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.691521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.691616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.691718] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.691918] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.691918] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.692240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.692402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.696293] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.696409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.696629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.697211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.697211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.697211] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbf13920-3db5-4f35-a4e0-72946a3675e1 is going to be updated. [ 635.721080] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.723084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.723201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.725921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.725921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.725921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbf13920-3db5-4f35-a4e0-72946a3675e1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.845107] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.846120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.846229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.846462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.846551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.846650] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f already deleted. [ 635.846732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.846880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.847812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.847901] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.925027] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-884a937d-f25c-4b98-be12-acfbdb273d70 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.925169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.925247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.925460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.926084] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.926084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.926084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.926084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.926084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.926395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.926395] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-884a937d-f25c-4b98-be12-acfbdb273d70 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.926395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.926488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.926565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.926696] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.926778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.927686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.927686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.927686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.927686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.927686] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('884a937d-f25c-4b98-be12-acfbdb273d70',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.200227] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.369210] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.369430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.369430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.369658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.369752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.369853] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f already deleted. [ 636.369936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.429674] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 884a937d-f25c-4b98-be12-acfbdb273d70: rpc.has_security_group_logging(os_id): False [ 636.463417] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.464241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.464241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.464241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.464241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.464241] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.464241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.464489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.464527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.464634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.464816] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.464915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.464977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.465140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.465215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.465398] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.465820] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.466015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.466235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.466364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.466541] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 884a937d-f25c-4b98-be12-acfbdb273d70 is going to be created. [ 636.489101] env[68109]: INFO networking_nsxv3.common.synchronization [None req-bb112319-51d3-49f2-ac1c-4aae413cd1e7 None None] Enqueued Resource ID: bdb9aa9c-4e29-4a42-9dde-a7cf164190ef with Priority: HIGHEST for action port [ 636.490245] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdb9aa9c-4e29-4a42-9dde-a7cf164190ef with Priority: HIGHEST for action port [ 636.490717] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdb9aa9c-4e29-4a42-9dde-a7cf164190ef taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.490852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdb9aa9c-4e29-4a42-9dde-a7cf164190ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.490958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdb9aa9c-4e29-4a42-9dde-a7cf164190ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.491277] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdb9aa9c-4e29-4a42-9dde-a7cf164190ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.491477] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdb9aa9c-4e29-4a42-9dde-a7cf164190ef',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.518670] env[68109]: INFO networking_nsxv3.common.synchronization [None req-5d81b5b6-667f-451b-aeee-0f081d1b51a4 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: d063caf8-0f34-48a0-8035-c8a07c90a01c with Priority: HIGHEST for action security_group_rules [ 636.518821] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d063caf8-0f34-48a0-8035-c8a07c90a01c with Priority: HIGHEST for action security_group_rules [ 636.519523] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d063caf8-0f34-48a0-8035-c8a07c90a01c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.519649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.519717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.519977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.520665] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d063caf8-0f34-48a0-8035-c8a07c90a01c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.562840] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.563103] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.563185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.563405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.563598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.573863] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 884a937d-f25c-4b98-be12-acfbdb273d70 in Status: IN_PROGRESS for 2s [ 636.702600] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.702880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.702969] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.703246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.703354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.703472] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 is going to be created. [ 636.727024] env[68109]: INFO networking_nsxv3.common.synchronization [None req-565dd7ec-08c2-48f4-b2ff-4715d6fb3d97 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: d063caf8-0f34-48a0-8035-c8a07c90a01c with Priority: HIGHEST for action security_group_rules [ 636.727514] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d063caf8-0f34-48a0-8035-c8a07c90a01c with Priority: HIGHEST for action security_group_rules [ 636.727813] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d063caf8-0f34-48a0-8035-c8a07c90a01c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.728024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.735909] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.736059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.736151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.736342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.737334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.746029] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 in Status: UNINITIALIZED for 2s [ 636.857625] env[68109]: INFO networking_nsxv3.common.synchronization [None req-b97ead0a-0005-4ad3-a1a8-db0c2090b051 tempest-ServersTestJSON-881419211 tempest-ServersTestJSON-881419211-project-member] Enqueued Resource ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 with Priority: HIGHEST for action security_group_rules [ 636.859105] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 with Priority: HIGHEST for action security_group_rules [ 636.859105] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.859105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.859105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.859105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.859377] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.996451] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bdb9aa9c-4e29-4a42-9dde-a7cf164190ef [ 636.996923] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.996923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.997082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.997286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.997352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.997467] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bdb9aa9c-4e29-4a42-9dde-a7cf164190ef already deleted. [ 636.997573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdb9aa9c-4e29-4a42-9dde-a7cf164190ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.045348] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.045510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.045569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.045781] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.045868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.045962] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d063caf8-0f34-48a0-8035-c8a07c90a01c already deleted. [ 637.046054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.046218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.046369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.046448] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d063caf8-0f34-48a0-8035-c8a07c90a01c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.147737] env[68109]: INFO networking_nsxv3.common.synchronization [None req-86cfae1c-ec27-4e88-9042-e3fd8e0a5b3d tempest-ServersTestJSON-881419211 tempest-ServersTestJSON-881419211-project-member] Enqueued Resource ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 with Priority: HIGHEST for action security_group_rules [ 637.147737] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 with Priority: HIGHEST for action security_group_rules [ 637.147910] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.148187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.379546] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.379699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.379772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.380111] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.380111] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.380233] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 already deleted. [ 637.380269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.380402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.380555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.380724] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.574585] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.575591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.575591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.575889] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.576046] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.576152] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d063caf8-0f34-48a0-8035-c8a07c90a01c already deleted. [ 637.576834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.600388] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 in Status: SUCCESS [ 637.600618] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 deletion is rescheduled due to dependency. [ 637.600906] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.694990] env[68109]: INFO networking_nsxv3.common.synchronization [req-e74dcc5b-5ba0-41ff-b3df-8a0e806617dc req-5c89911e-04d3-41ab-bdbe-bace65e92cda tempest-ServerDiskConfigTestJSON-1064584538 tempest-ServerDiskConfigTestJSON-1064584538-project-member] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 637.695621] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 637.695938] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.697571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.697663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.697941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.698272] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.699303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.699303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.699303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.699303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.699303] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.901992] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.901992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.901992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.901992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.901992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.901992] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 already deleted. [ 637.901992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.204394] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.204394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.204394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.204394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.204394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.204394] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.204394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.204394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.204394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.204394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.204394] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 already deleted. [ 638.204394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.492169] env[68109]: INFO networking_nsxv3.common.synchronization [req-150f4479-69e4-42b9-b267-e16ad30ed138 req-942924f7-df08-4523-995a-4911b3446859 tempest-SecurityGroupRulesTestJSON-1543358915 tempest-SecurityGroupRulesTestJSON-1543358915-project-member] Enqueued Resource ID: 549262c8-d73e-4ae6-9683-d8f0e37f3ca4 with Priority: HIGHEST for action security_group_rules [ 638.492706] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549262c8-d73e-4ae6-9683-d8f0e37f3ca4 with Priority: HIGHEST for action security_group_rules [ 638.493066] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-549262c8-d73e-4ae6-9683-d8f0e37f3ca4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.493162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-549262c8-d73e-4ae6-9683-d8f0e37f3ca4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.493237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-549262c8-d73e-4ae6-9683-d8f0e37f3ca4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.493482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-549262c8-d73e-4ae6-9683-d8f0e37f3ca4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.493564] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('549262c8-d73e-4ae6-9683-d8f0e37f3ca4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.586466] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 884a937d-f25c-4b98-be12-acfbdb273d70 in Status: SUCCESS [ 638.586466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.631259] env[68109]: INFO networking_nsxv3.common.synchronization [req-bfb1f5e9-920f-480a-b2a7-3e963ced7b1e req-083f4ae8-5432-472f-ba9d-90ea90e5f105 tempest-DeleteServersTestJSON-2063667557 tempest-DeleteServersTestJSON-2063667557-project-member] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 638.631644] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 638.631955] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.632517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.632611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.632799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.633062] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.633243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.633319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.633495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.633617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.633902] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.743342] env[68109]: INFO networking_nsxv3.common.synchronization [None req-a5862bfd-e61e-44d7-98d2-9d058ee7fc25 None None] Enqueued Resource ID: 9627bd27-fbae-4ebe-82dd-1fdbf1389aac with Priority: HIGHEST for action port [ 638.743689] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9627bd27-fbae-4ebe-82dd-1fdbf1389aac with Priority: HIGHEST for action port [ 638.744350] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-9627bd27-fbae-4ebe-82dd-1fdbf1389aac taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.744476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9627bd27-fbae-4ebe-82dd-1fdbf1389aac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.744545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9627bd27-fbae-4ebe-82dd-1fdbf1389aac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.744793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9627bd27-fbae-4ebe-82dd-1fdbf1389aac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.744906] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9627bd27-fbae-4ebe-82dd-1fdbf1389aac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.757101] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 in Status: SUCCESS [ 638.757101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.757101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.757511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.757511] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.757511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.757511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.757652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.757990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.757990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.757990] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.896389] env[68109]: INFO networking_nsxv3.common.synchronization [None req-9b5af5c1-1ddf-4f41-98c2-bb25f128b274 None None] Enqueued Resource ID: 13b7c5f5-5961-4d58-a483-26b9f00bd6c9 with Priority: HIGHEST for action port [ 638.896847] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b7c5f5-5961-4d58-a483-26b9f00bd6c9 with Priority: HIGHEST for action port [ 638.897368] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-13b7c5f5-5961-4d58-a483-26b9f00bd6c9 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.897491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13b7c5f5-5961-4d58-a483-26b9f00bd6c9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.897549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13b7c5f5-5961-4d58-a483-26b9f00bd6c9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.897799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13b7c5f5-5961-4d58-a483-26b9f00bd6c9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.897881] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13b7c5f5-5961-4d58-a483-26b9f00bd6c9',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.924737] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-332 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.925018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.925051] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.925364] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.925610] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.925761] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.925875] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.926147] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.926294] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.926529] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 638.926646] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.926757] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.926872] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.926985] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 638.927206] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.927307] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.945630] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.946388] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 638.946628] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.946908] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.950429] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-c8c3bb26-134a-420a-a407-92264ee556f2 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.950429] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-c8c3bb26-134a-420a-a407-92264ee556f2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.950429] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-c8c3bb26-134a-420a-a407-92264ee556f2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.950429] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-c8c3bb26-134a-420a-a407-92264ee556f2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.950429] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8c3bb26-134a-420a-a407-92264ee556f2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.017893] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.018091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.018135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.018340] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.018431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.018537] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 549262c8-d73e-4ae6-9683-d8f0e37f3ca4 already deleted. [ 639.018613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-549262c8-d73e-4ae6-9683-d8f0e37f3ca4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.137233] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.137233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.137233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.137233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.137233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.137233] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.137233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.137856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.137856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.137856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.137856] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 639.162936] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.163162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.163234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.163479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.163867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.172833] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 639.252926] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9627bd27-fbae-4ebe-82dd-1fdbf1389aac [ 639.252926] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.253181] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.253181] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.253416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.253559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.253704] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9627bd27-fbae-4ebe-82dd-1fdbf1389aac already deleted. [ 639.253818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9627bd27-fbae-4ebe-82dd-1fdbf1389aac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.260449] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.260603] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.260682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.260883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.261068] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.261184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.261262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.261421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.261594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.261776] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.261848] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.261944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.262013] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.262193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.262335] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.262429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.262494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.262941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.262941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.262941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.262941] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.401305] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13b7c5f5-5961-4d58-a483-26b9f00bd6c9 [ 639.402412] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.402412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.402412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.402638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.402638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.402756] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13b7c5f5-5961-4d58-a483-26b9f00bd6c9 already deleted. [ 639.403223] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13b7c5f5-5961-4d58-a483-26b9f00bd6c9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.453227] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.455430] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.455430] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.455430] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.455430] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.455430] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port c8c3bb26-134a-420a-a407-92264ee556f2 not found, creating... [ 639.455430] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.455430] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.455430] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.455430] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.455430] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.456128] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.456128] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.456128] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.456128] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.456128] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.459065] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: c8c3bb26-134a-420a-a407-92264ee556f2 is going to be created. [ 639.478503] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.478709] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.478832] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.479145] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.479421] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.479646] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-c8c3bb26-134a-420a-a407-92264ee556f2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.750267] env[68109]: INFO networking_nsxv3.common.synchronization [None req-18cb71f1-150c-4196-969d-e86135a28056 tempest-AttachVolumeShelveTestJSON-1309092891 tempest-AttachVolumeShelveTestJSON-1309092891-project-member] Enqueued Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_rules [ 639.750862] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_rules [ 639.751587] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50bf3a02-de03-46e5-a1de-389d8f706b9b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.751728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.751790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.754947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.755014] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.765819] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa5eec70-e6f3-4480-95eb-d20df1020e05: rpc.has_security_group_logging(os_id): False [ 639.794566] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.794692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.794763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.794970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.795075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.795263] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.796255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.796323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.796695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.797105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.797219] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.797291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.797360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.797526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.797602] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.797844] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.797913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.797949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.798106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.798181] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.798267] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 is going to be created. [ 639.867043] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.867043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.867043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.867043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.867043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.875772] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 in Status: IN_PROGRESS for 2s [ 639.884192] env[68109]: INFO networking_nsxv3.common.synchronization [req-310f123e-0ddd-4737-96f8-7c8e0f9b11d9 req-b5b858d3-52f4-4b21-bb1f-6f8c638257c8 tempest-ServersAdminNegativeTestJSON-2123175983 tempest-ServersAdminNegativeTestJSON-2123175983-project-member] Enqueued Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_members [ 639.885060] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_members [ 639.886234] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.886761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.886761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.886996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.887255] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.887339] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.887936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.888018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.888054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.888168] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.060681] env[68109]: INFO networking_nsxv3.common.synchronization [None req-98c0fffb-7629-461d-b065-076cc8b75c92 tempest-AttachVolumeShelveTestJSON-1309092891 tempest-AttachVolumeShelveTestJSON-1309092891-project-member] Enqueued Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_rules [ 640.061659] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_rules [ 640.062340] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50bf3a02-de03-46e5-a1de-389d8f706b9b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.062340] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.275593] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.275593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.275593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.275870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.276089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.276089] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b already deleted. [ 640.276858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.276858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.276858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.276858] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.390502] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.390704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.390777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.391017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.391167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.391449] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.391551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.391618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.391786] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.391857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.391940] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee121dc7-4686-4564-b58a-255456cf3857 already deleted. [ 640.392027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.797577] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.797577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.797577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.797577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.797577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.797577] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b already deleted. [ 640.797577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.938225] env[68109]: INFO networking_nsxv3.common.synchronization [req-e74dcc5b-5ba0-41ff-b3df-8a0e806617dc req-7e307492-c5b9-4ac6-953f-4c93e8ee5c3e service nova] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_rules [ 640.938225] env[68109]: INFO networking_nsxv3.common.synchronization [req-e74dcc5b-5ba0-41ff-b3df-8a0e806617dc req-7e307492-c5b9-4ac6-953f-4c93e8ee5c3e service nova] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 640.938225] env[68109]: INFO networking_nsxv3.common.synchronization [req-e74dcc5b-5ba0-41ff-b3df-8a0e806617dc req-7e307492-c5b9-4ac6-953f-4c93e8ee5c3e service nova] Enqueued Resource ID: c8c3bb26-134a-420a-a407-92264ee556f2 with Priority: HIGHEST for action port [ 640.942024] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_rules [ 640.942024] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 640.942024] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8c3bb26-134a-420a-a407-92264ee556f2 with Priority: HIGHEST for action port [ 640.942024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.942024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.942024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.942024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.942024] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.942024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.942024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.942024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.942024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.942024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.942024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.942024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.942024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.942024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.942024] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.944318] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8c3bb26-134a-420a-a407-92264ee556f2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.946200] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8c3bb26-134a-420a-a407-92264ee556f2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.946295] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8c3bb26-134a-420a-a407-92264ee556f2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.946475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8c3bb26-134a-420a-a407-92264ee556f2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.946563] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8c3bb26-134a-420a-a407-92264ee556f2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.994082] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.994082] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.994082] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.994082] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.995106] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.995612] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.997101] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.000019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.000019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.000019] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 641.000019] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.000019] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.000019] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.000019] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 641.000019] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.000019] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.020813] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.020984] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 641.021174] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.021519] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.021787] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-cf6ca851-11c5-487e-a71f-77ba2f47aaf4 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.021787] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-cf6ca851-11c5-487e-a71f-77ba2f47aaf4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.021919] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-cf6ca851-11c5-487e-a71f-77ba2f47aaf4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.022624] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-cf6ca851-11c5-487e-a71f-77ba2f47aaf4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.023995] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf6ca851-11c5-487e-a71f-77ba2f47aaf4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.193203] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 641.193203] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 deletion is rescheduled due to dependency. [ 641.193203] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.448817] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.448905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.449116] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.450637] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8c3bb26-134a-420a-a407-92264ee556f2 with status ACTIVE [ 641.450832] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.450965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.451055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.451275] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.451477] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.451560] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.451616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.451689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.452029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.452029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.452226] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.452436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.452537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.452656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.452734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.452874] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8c3bb26-134a-420a-a407-92264ee556f2 is going to be updated. [ 641.482234] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.482452] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.482452] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.482661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.482786] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.482951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8c3bb26-134a-420a-a407-92264ee556f2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.529550] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.529550] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.529550] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.529550] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.529550] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.529730] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port cf6ca851-11c5-487e-a71f-77ba2f47aaf4 not found, creating... [ 641.529876] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.530096] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.530182] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.530755] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.530755] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.530892] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.531237] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.531237] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.531425] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.531425] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.531563] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: cf6ca851-11c5-487e-a71f-77ba2f47aaf4 is going to be created. [ 641.534929] env[68109]: INFO networking_nsxv3.common.synchronization [None req-2063225c-63d1-41bf-947b-71fc449b7267 None None] Enqueued Resource ID: f42f73e6-c421-4a42-8e44-a62faf631548 with Priority: HIGHEST for action port [ 641.537323] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f42f73e6-c421-4a42-8e44-a62faf631548 with Priority: HIGHEST for action port [ 641.537323] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f42f73e6-c421-4a42-8e44-a62faf631548 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.537323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f42f73e6-c421-4a42-8e44-a62faf631548" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.537323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f42f73e6-c421-4a42-8e44-a62faf631548" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.537323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f42f73e6-c421-4a42-8e44-a62faf631548" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.537323] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f42f73e6-c421-4a42-8e44-a62faf631548',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.554503] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.554503] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.554503] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.556634] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.556634] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.556634] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-cf6ca851-11c5-487e-a71f-77ba2f47aaf4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.889267] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 in Status: SUCCESS [ 641.889542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.956197] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.039983] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f42f73e6-c421-4a42-8e44-a62faf631548 [ 642.040265] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.040401] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.040577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.040672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.040757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.040850] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f42f73e6-c421-4a42-8e44-a62faf631548 already deleted. [ 642.040929] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f42f73e6-c421-4a42-8e44-a62faf631548" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.460059] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.460190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.460190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.460543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.460543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.460543] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be created. [ 642.485014] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.485014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.485014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.485014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.485014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.492229] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: UNINITIALIZED for 2s [ 642.661611] env[68109]: INFO networking_nsxv3.common.synchronization [None req-4a6ce87f-ea25-4984-a1d5-3cb0cba4eeb9 tempest-ServerActionsTestOtherB-1748290489 tempest-ServerActionsTestOtherB-1748290489-project-member] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_rules [ 642.662355] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_rules [ 642.662746] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.662875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.662945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.663438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.663530] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.873972] env[68109]: INFO networking_nsxv3.common.synchronization [None req-1af30aaf-e5d2-4a5a-8925-f44aeb4d7233 tempest-ServerActionsTestOtherB-1748290489 tempest-ServerActionsTestOtherB-1748290489-project-member] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_rules [ 642.873972] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_rules [ 642.873972] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.873972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.948009] env[68109]: INFO networking_nsxv3.common.synchronization [req-310f123e-0ddd-4737-96f8-7c8e0f9b11d9 req-11eb44a0-732b-42d2-a087-251d942659f4 service nova] Enqueued Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_rules [ 642.948471] env[68109]: INFO networking_nsxv3.common.synchronization [req-310f123e-0ddd-4737-96f8-7c8e0f9b11d9 req-11eb44a0-732b-42d2-a087-251d942659f4 service nova] Enqueued Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_members [ 642.949631] env[68109]: INFO networking_nsxv3.common.synchronization [req-310f123e-0ddd-4737-96f8-7c8e0f9b11d9 req-11eb44a0-732b-42d2-a087-251d942659f4 service nova] Enqueued Resource ID: cf6ca851-11c5-487e-a71f-77ba2f47aaf4 with Priority: HIGHEST for action port [ 642.950494] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_rules [ 642.950846] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_members [ 642.951692] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf6ca851-11c5-487e-a71f-77ba2f47aaf4 with Priority: HIGHEST for action port [ 642.952088] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.952669] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.952739] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.953660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.953870] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.954912] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.955828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.955944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.956450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.956662] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.956779] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.956862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.960030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.960030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.960030] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.960030] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf6ca851-11c5-487e-a71f-77ba2f47aaf4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.960030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf6ca851-11c5-487e-a71f-77ba2f47aaf4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.960030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf6ca851-11c5-487e-a71f-77ba2f47aaf4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.960030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf6ca851-11c5-487e-a71f-77ba2f47aaf4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.960030] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf6ca851-11c5-487e-a71f-77ba2f47aaf4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.185038] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.185038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.185038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.185038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.185038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.185309] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 already deleted. [ 643.185309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.185427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.186403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.186403] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.461433] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.462881] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.463078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.464643] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf6ca851-11c5-487e-a71f-77ba2f47aaf4 with status ACTIVE [ 643.464643] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.464643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.464643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.464643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.464643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.464643] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.464643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.464643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.465719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.465795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.466279] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.466550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.466550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.466891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.466891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.467143] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf6ca851-11c5-487e-a71f-77ba2f47aaf4 is going to be updated. [ 643.495825] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.495825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.495825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.495825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.495825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.495825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf6ca851-11c5-487e-a71f-77ba2f47aaf4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.713845] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.713980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.714072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.714292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.714425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.714545] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 already deleted. [ 643.714632] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.970181] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.319079] env[68109]: INFO networking_nsxv3.common.synchronization [req-2a0bd180-6e8b-49d1-849c-52168e475882 req-7f5defe1-71c2-4abc-bd54-e79484267374 tempest-ServerExternalEventsTest-1705449308 tempest-ServerExternalEventsTest-1705449308-project-member] Enqueued Resource ID: e830dadd-514a-4590-801f-e2bdf550c9d4 with Priority: HIGHEST for action security_group_members [ 644.319079] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e830dadd-514a-4590-801f-e2bdf550c9d4 with Priority: HIGHEST for action security_group_members [ 644.319079] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e830dadd-514a-4590-801f-e2bdf550c9d4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.319079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.319079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.319079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.319079] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.319079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.319079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.319511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.319511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.319511] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e830dadd-514a-4590-801f-e2bdf550c9d4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.426364] env[68109]: INFO networking_nsxv3.common.synchronization [None req-97ec7f99-7f95-4d7c-998d-67a8b1eb2856 None None] Enqueued Resource ID: 74535d24-12af-4c10-bb60-d190f6ff3264 with Priority: HIGHEST for action port [ 644.426876] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74535d24-12af-4c10-bb60-d190f6ff3264 with Priority: HIGHEST for action port [ 644.426983] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-74535d24-12af-4c10-bb60-d190f6ff3264 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.427123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74535d24-12af-4c10-bb60-d190f6ff3264" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.427209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74535d24-12af-4c10-bb60-d190f6ff3264" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.427442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74535d24-12af-4c10-bb60-d190f6ff3264" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.427549] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74535d24-12af-4c10-bb60-d190f6ff3264',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.452500] env[68109]: INFO networking_nsxv3.common.synchronization [req-fc8a9294-1ff1-4ed4-8ba6-1b86f8251cbc req-51d47a8b-7fe4-4ba6-8098-dfa77c3cf3ff tempest-VolumesAssistedSnapshotsTest-142452177 tempest-VolumesAssistedSnapshotsTest-142452177-project-member] Enqueued Resource ID: 80fea482-6d64-4937-892c-62371db01817 with Priority: HIGHEST for action security_group_members [ 644.452981] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80fea482-6d64-4937-892c-62371db01817 with Priority: HIGHEST for action security_group_members [ 644.454129] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-80fea482-6d64-4937-892c-62371db01817 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.454258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.454258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.454604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.455169] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.455350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.455431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.455903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.456015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.456095] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80fea482-6d64-4937-892c-62371db01817',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.472755] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.472755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.472755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.472755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.473104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.473104] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee121dc7-4686-4564-b58a-255456cf3857 is going to be created. [ 644.497624] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.497624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.497624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.497624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.497624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.501152] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 644.501361] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.501524] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.501721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.501900] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.502031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.502099] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.502276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.502356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.502463] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.502541] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.506717] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee121dc7-4686-4564-b58a-255456cf3857 in Status: UNINITIALIZED for 2s [ 644.824197] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.824197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.824197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.824197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.824197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.824495] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.824864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.824943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.825084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.825737] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.826288] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e830dadd-514a-4590-801f-e2bdf550c9d4 is going to be updated. [ 644.860047] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.860047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.860047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.860047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.860047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.868198] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e830dadd-514a-4590-801f-e2bdf550c9d4 in Status: IN_PROGRESS for 2s [ 644.932627] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74535d24-12af-4c10-bb60-d190f6ff3264 [ 644.932627] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.932627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.932627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.932627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.932627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.932627] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74535d24-12af-4c10-bb60-d190f6ff3264 already deleted. [ 644.932627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74535d24-12af-4c10-bb60-d190f6ff3264" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.960158] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.960158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.960158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.960158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.960158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.960158] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.960158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.960158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.960606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.960606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.960606] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80fea482-6d64-4937-892c-62371db01817 already deleted. [ 644.960606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.007782] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.007782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.007782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.007782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.007782] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.007782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.007782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.007782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.007782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.007782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.007782] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.007782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.007782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.007782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.007782] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.007782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.008525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.008525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.008525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.008525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.008525] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.035975] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.035975] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-916" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.035975] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-916" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.036547] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-916" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.036547] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.036547] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.036797] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.037619] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.037619] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.037619] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.037619] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.037619] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.037619] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.038087] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.038087] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.038087] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.057096] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.057197] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 645.057403] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.057615] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-916" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.057927] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-6d65ec95-cd3c-4847-bf24-17975d1e674d taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.058161] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-6d65ec95-cd3c-4847-bf24-17975d1e674d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.058236] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-6d65ec95-cd3c-4847-bf24-17975d1e674d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.058558] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-6d65ec95-cd3c-4847-bf24-17975d1e674d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.058694] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d65ec95-cd3c-4847-bf24-17975d1e674d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.303162] env[68109]: INFO networking_nsxv3.common.synchronization [req-c25c036e-ea91-4cba-9a3a-05c17c79132e req-a9efb29f-f703-4b75-99b6-9b2ea2786b54 tempest-SecurityGroupRulesTestJSON-1543358915 tempest-SecurityGroupRulesTestJSON-1543358915-project-member] Enqueued Resource ID: e6e22693-ae9b-4ddf-b3c4-1c571b592f6c with Priority: HIGHEST for action security_group_rules [ 645.303346] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6e22693-ae9b-4ddf-b3c4-1c571b592f6c with Priority: HIGHEST for action security_group_rules [ 645.303735] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.303807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.303851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.306247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.306247] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6e22693-ae9b-4ddf-b3c4-1c571b592f6c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.513335] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7eff74c-b690-47ef-ba84-9ec9d2765c99: rpc.has_security_group_logging(os_id): False [ 645.531872] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.531872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.531872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.531872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.531872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.531872] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.532474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.532474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.532474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.532474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.532632] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.532696] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.532921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.532995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.533089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.533339] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.533476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.533529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.533703] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.533819] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.533956] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be created. [ 645.566347] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.566543] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.566668] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.566965] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.567206] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.567397] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 6d65ec95-cd3c-4847-bf24-17975d1e674d not found, creating... [ 645.567644] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.568115] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.568115] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.568408] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.568592] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.568884] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.569050] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.569174] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.569424] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.569566] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.569711] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 6d65ec95-cd3c-4847-bf24-17975d1e674d is going to be created. [ 645.585484] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.585646] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.585725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.585952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.586151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.588477] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.588718] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.588858] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.589127] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.589340] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.589572] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-6d65ec95-cd3c-4847-bf24-17975d1e674d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.601228] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 645.831443] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.831701] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.831701] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.831827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.831935] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.832037] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6e22693-ae9b-4ddf-b3c4-1c571b592f6c already deleted. [ 645.832169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.520920] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee121dc7-4686-4564-b58a-255456cf3857 in Status: SUCCESS [ 646.521943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.521943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.522274] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.522543] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.522543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.523067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.523067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.523067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.524814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.524814] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.695030] env[68109]: INFO networking_nsxv3.common.synchronization [req-fc8a9294-1ff1-4ed4-8ba6-1b86f8251cbc req-329c9b12-dd4a-487f-b6e2-fc63aca30067 service nova] Enqueued Resource ID: 80fea482-6d64-4937-892c-62371db01817 with Priority: HIGHEST for action security_group_rules [ 646.695205] env[68109]: INFO networking_nsxv3.common.synchronization [req-fc8a9294-1ff1-4ed4-8ba6-1b86f8251cbc req-329c9b12-dd4a-487f-b6e2-fc63aca30067 service nova] Enqueued Resource ID: 80fea482-6d64-4937-892c-62371db01817 with Priority: HIGHEST for action security_group_members [ 646.695417] env[68109]: INFO networking_nsxv3.common.synchronization [req-fc8a9294-1ff1-4ed4-8ba6-1b86f8251cbc req-329c9b12-dd4a-487f-b6e2-fc63aca30067 service nova] Enqueued Resource ID: 6d65ec95-cd3c-4847-bf24-17975d1e674d with Priority: HIGHEST for action port [ 646.695579] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80fea482-6d64-4937-892c-62371db01817 with Priority: HIGHEST for action security_group_rules [ 646.695804] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80fea482-6d64-4937-892c-62371db01817 with Priority: HIGHEST for action security_group_members [ 646.695934] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d65ec95-cd3c-4847-bf24-17975d1e674d with Priority: HIGHEST for action port [ 646.696532] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80fea482-6d64-4937-892c-62371db01817 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.696660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.697217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.697402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.697505] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80fea482-6d64-4937-892c-62371db01817',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.698443] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-80fea482-6d64-4937-892c-62371db01817 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.698640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.698640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.698811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.698963] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.699412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.699412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.699544] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.699621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.699719] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80fea482-6d64-4937-892c-62371db01817',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.701209] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d65ec95-cd3c-4847-bf24-17975d1e674d taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.701346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d65ec95-cd3c-4847-bf24-17975d1e674d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.701346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d65ec95-cd3c-4847-bf24-17975d1e674d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.701471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d65ec95-cd3c-4847-bf24-17975d1e674d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.701621] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d65ec95-cd3c-4847-bf24-17975d1e674d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.881428] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e830dadd-514a-4590-801f-e2bdf550c9d4 in Status: SUCCESS [ 646.881725] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e830dadd-514a-4590-801f-e2bdf550c9d4 deletion is rescheduled due to dependency. [ 646.881908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.027029] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.027029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.027029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.027325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.027409] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.027510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.027570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.027729] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.027819] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.027906] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.028071] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.028159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.028218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.028360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.028526] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.028623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.028682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.028831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.029828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.029828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.029828] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.203833] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80fea482-6d64-4937-892c-62371db01817',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.205030] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-80fea482-6d64-4937-892c-62371db01817 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.205177] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.205347] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d65ec95-cd3c-4847-bf24-17975d1e674d with status ACTIVE [ 647.205524] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.205688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.205688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.205932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.206029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.206220] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.206350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.206414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.206579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.206661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.206901] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.207810] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.207915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.208639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.208639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.210672] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d65ec95-cd3c-4847-bf24-17975d1e674d is going to be updated. [ 647.237733] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.237733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.237733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.237733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.237733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.237733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d65ec95-cd3c-4847-bf24-17975d1e674d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.286144] env[68109]: INFO networking_nsxv3.common.synchronization [None req-ac40d0c8-55be-4299-9031-4e61de0bdf05 None None] Enqueued Resource ID: 5a3c0b6c-09d0-4286-9e8b-350e4b2cef31 with Priority: HIGHEST for action port [ 647.286144] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a3c0b6c-09d0-4286-9e8b-350e4b2cef31 with Priority: HIGHEST for action port [ 647.286144] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a3c0b6c-09d0-4286-9e8b-350e4b2cef31 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.286144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a3c0b6c-09d0-4286-9e8b-350e4b2cef31" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.286144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a3c0b6c-09d0-4286-9e8b-350e4b2cef31" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.287107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a3c0b6c-09d0-4286-9e8b-350e4b2cef31" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.287443] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a3c0b6c-09d0-4286-9e8b-350e4b2cef31',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.478295] env[68109]: INFO networking_nsxv3.common.synchronization [req-3aa764a0-73dd-464a-b1df-8ee3ff87560b req-b87a4fc4-1317-46f1-bbdb-9dd4a323a252 tempest-SecurityGroupRulesTestJSON-1543358915 tempest-SecurityGroupRulesTestJSON-1543358915-project-member] Enqueued Resource ID: e6e22693-ae9b-4ddf-b3c4-1c571b592f6c with Priority: HIGHEST for action security_group_rules [ 647.478891] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6e22693-ae9b-4ddf-b3c4-1c571b592f6c with Priority: HIGHEST for action security_group_rules [ 647.479996] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.479996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.479996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.479996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.480699] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6e22693-ae9b-4ddf-b3c4-1c571b592f6c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.533127] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee121dc7-4686-4564-b58a-255456cf3857: rpc.has_security_group_logging(os_id): False [ 647.552421] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.552774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.552899] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.553304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.553537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.553919] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.554179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.554313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.555314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.555314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.555314] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.555314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.555314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.555550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.555550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.555885] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.555885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.556139] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.556322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.556380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.556455] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee121dc7-4686-4564-b58a-255456cf3857 is going to be created. [ 647.615566] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.615566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.615566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.615566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.615566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.616251] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 647.616669] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.620903] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee121dc7-4686-4564-b58a-255456cf3857 in Status: IN_PROGRESS for 2s [ 647.717435] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80fea482-6d64-4937-892c-62371db01817',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.718326] env[68109]: INFO networking_nsxv3.common.synchronization [None req-cdeda453-65f0-499c-98bf-60520facca93 None None] Enqueued Resource ID: a90c3e69-035f-45c7-b5ad-5bb284679c36 with Priority: HIGHEST for action port [ 647.718771] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a90c3e69-035f-45c7-b5ad-5bb284679c36 with Priority: HIGHEST for action port [ 647.721354] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-a90c3e69-035f-45c7-b5ad-5bb284679c36 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.721354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a90c3e69-035f-45c7-b5ad-5bb284679c36" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.721354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a90c3e69-035f-45c7-b5ad-5bb284679c36" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.721354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a90c3e69-035f-45c7-b5ad-5bb284679c36" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.721354] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a90c3e69-035f-45c7-b5ad-5bb284679c36',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.791588] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a3c0b6c-09d0-4286-9e8b-350e4b2cef31 [ 647.791806] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.791935] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.792353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.792578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.792669] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.792786] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a3c0b6c-09d0-4286-9e8b-350e4b2cef31 already deleted. [ 647.792869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a3c0b6c-09d0-4286-9e8b-350e4b2cef31" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.001044] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.001247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.001339] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.001563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.001675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.001783] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6e22693-ae9b-4ddf-b3c4-1c571b592f6c already deleted. [ 648.001858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.223539] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.223539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.223539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.223539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.223539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.223539] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80fea482-6d64-4937-892c-62371db01817 is going to be created. [ 648.223539] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a90c3e69-035f-45c7-b5ad-5bb284679c36 [ 648.223539] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.223539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.223539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.224356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.224356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.224356] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a90c3e69-035f-45c7-b5ad-5bb284679c36 already deleted. [ 648.224356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a90c3e69-035f-45c7-b5ad-5bb284679c36" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.246752] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.246752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.246752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.246752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.246752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.258969] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80fea482-6d64-4937-892c-62371db01817 in Status: UNINITIALIZED for 2s [ 648.500964] env[68109]: INFO networking_nsxv3.common.synchronization [req-6efe73ae-ab23-43ba-9c39-73876ac24d74 req-df4e863c-1616-4cb6-a6d4-03db11312ce4 tempest-ServerDiagnosticsNegativeTest-305206900 tempest-ServerDiagnosticsNegativeTest-305206900-project-member] Enqueued Resource ID: 884a937d-f25c-4b98-be12-acfbdb273d70 with Priority: HIGHEST for action security_group_members [ 648.501505] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884a937d-f25c-4b98-be12-acfbdb273d70 with Priority: HIGHEST for action security_group_members [ 648.501687] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-884a937d-f25c-4b98-be12-acfbdb273d70 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.501997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.501997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.503035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.503035] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.503035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.503035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.503035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.503035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.503352] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('884a937d-f25c-4b98-be12-acfbdb273d70',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.798993] env[68109]: INFO networking_nsxv3.common.synchronization [None req-e16fadde-f8d5-4d5f-9f13-51d0fbf3e2de tempest-ServersTestFqdnHostnames-402908171 tempest-ServersTestFqdnHostnames-402908171-project-member] Enqueued Resource ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc with Priority: HIGHEST for action security_group_rules [ 648.799549] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc with Priority: HIGHEST for action security_group_rules [ 648.800203] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.801182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.801182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.801362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.801470] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be0b8028-d9fc-4359-aba8-9adf2a89c6bc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.006942] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.007339] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.007339] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.007493] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.007596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.007791] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.007912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.008091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.008144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.008415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.008415] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 884a937d-f25c-4b98-be12-acfbdb273d70 is going to be updated. [ 649.035978] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.036171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.036253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.036543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.036826] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.104128] env[68109]: INFO networking_nsxv3.common.synchronization [None req-e435019c-e2a0-4df7-8c1d-656e513a6e62 tempest-ServersTestFqdnHostnames-402908171 tempest-ServersTestFqdnHostnames-402908171-project-member] Enqueued Resource ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc with Priority: HIGHEST for action security_group_rules [ 649.104908] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc with Priority: HIGHEST for action security_group_rules [ 649.105359] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.105770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.192740] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884a937d-f25c-4b98-be12-acfbdb273d70 in Status: IN_PROGRESS for 2s [ 649.322868] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.323080] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.323240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.323474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.323689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.323689] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc already deleted. [ 649.323807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.324014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.324190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.324275] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be0b8028-d9fc-4359-aba8-9adf2a89c6bc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.545087] env[68109]: INFO networking_nsxv3.common.synchronization [None req-1dd4a9dc-162d-4b50-9d0f-e04de79b9904 None None] Enqueued Resource ID: 2fb9d2c6-f5c1-4b54-b2bb-a731ffd6fdd4 with Priority: HIGHEST for action port [ 649.547980] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb9d2c6-f5c1-4b54-b2bb-a731ffd6fdd4 with Priority: HIGHEST for action port [ 649.547980] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fb9d2c6-f5c1-4b54-b2bb-a731ffd6fdd4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.547980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fb9d2c6-f5c1-4b54-b2bb-a731ffd6fdd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.547980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fb9d2c6-f5c1-4b54-b2bb-a731ffd6fdd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.548416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fb9d2c6-f5c1-4b54-b2bb-a731ffd6fdd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.548595] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fb9d2c6-f5c1-4b54-b2bb-a731ffd6fdd4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.637916] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee121dc7-4686-4564-b58a-255456cf3857 in Status: SUCCESS [ 649.638250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.819857] env[68109]: INFO networking_nsxv3.common.synchronization [req-1a7e2839-9ac4-4567-b488-52a10b1c1758 req-7d02c487-5af6-4fce-a938-91b5dbaaf68e tempest-ServerDiagnosticsTest-8702156 tempest-ServerDiagnosticsTest-8702156-project-member] Enqueued Resource ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 with Priority: HIGHEST for action security_group_members [ 649.820441] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 with Priority: HIGHEST for action security_group_members [ 649.820744] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-14fbc65b-2397-4f06-bab2-162f42e5d290 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.821753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.821892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.822202] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.822523] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.822670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.822759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.822959] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.823105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.823327] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14fbc65b-2397-4f06-bab2-162f42e5d290',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.849316] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.849483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.849581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.849872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.850424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.850628] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc already deleted. [ 649.850753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.052055] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fb9d2c6-f5c1-4b54-b2bb-a731ffd6fdd4 [ 650.052055] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.052055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.052055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.052582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.052582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.052777] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fb9d2c6-f5c1-4b54-b2bb-a731ffd6fdd4 already deleted. [ 650.053579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fb9d2c6-f5c1-4b54-b2bb-a731ffd6fdd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.269789] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80fea482-6d64-4937-892c-62371db01817 in Status: SUCCESS [ 650.269789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.270060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.270060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.270571] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.270571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.270977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.270977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.270977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.270977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.271401] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80fea482-6d64-4937-892c-62371db01817',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.329652] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.329652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.329652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.329652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.329652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.329652] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.329652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.329652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.329652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.329652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.329652] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 already deleted. [ 650.329652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.398683] env[68109]: INFO networking_nsxv3.common.synchronization [req-3eaadf32-88fc-4f08-a3fb-a00be2c22dfe req-dfd35041-990f-461f-8ede-ab4d7dcaff50 tempest-SecurityGroupRulesTestJSON-1543358915 tempest-SecurityGroupRulesTestJSON-1543358915-project-member] Enqueued Resource ID: e6e22693-ae9b-4ddf-b3c4-1c571b592f6c with Priority: HIGHEST for action security_group_rules [ 650.399546] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6e22693-ae9b-4ddf-b3c4-1c571b592f6c with Priority: HIGHEST for action security_group_rules [ 650.399933] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.400097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.400205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.400435] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.400575] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6e22693-ae9b-4ddf-b3c4-1c571b592f6c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.511744] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.511744] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.511744] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.511744] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.511744] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.511744] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.511744] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.511744] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.512257] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.512869] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.514020] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.514020] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.514020] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.514020] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.514020] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.514020] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.533305] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.533995] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 650.534237] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.534457] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.535199] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-86d4188a-6ff8-4427-a8ca-1c8d6a96e763 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.535199] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-86d4188a-6ff8-4427-a8ca-1c8d6a96e763" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.535199] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-86d4188a-6ff8-4427-a8ca-1c8d6a96e763" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.535557] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-86d4188a-6ff8-4427-a8ca-1c8d6a96e763" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.535716] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86d4188a-6ff8-4427-a8ca-1c8d6a96e763',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.667390] env[68109]: INFO networking_nsxv3.common.synchronization [None req-4fffcaff-0687-438f-85c0-a187ac184af9 None None] Enqueued Resource ID: 2e69c098-0604-4bc9-b238-58e7b66303f1 with Priority: HIGHEST for action port [ 650.668226] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e69c098-0604-4bc9-b238-58e7b66303f1 with Priority: HIGHEST for action port [ 650.668226] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e69c098-0604-4bc9-b238-58e7b66303f1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.668558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e69c098-0604-4bc9-b238-58e7b66303f1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.668558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e69c098-0604-4bc9-b238-58e7b66303f1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.670766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e69c098-0604-4bc9-b238-58e7b66303f1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.670766] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e69c098-0604-4bc9-b238-58e7b66303f1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.774935] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80fea482-6d64-4937-892c-62371db01817',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.921402] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.921963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.921963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.921963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.921963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.922126] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6e22693-ae9b-4ddf-b3c4-1c571b592f6c already deleted. [ 650.922126] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6e22693-ae9b-4ddf-b3c4-1c571b592f6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.039070] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.039322] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.039529] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.039781] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.040058] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.040235] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 86d4188a-6ff8-4427-a8ca-1c8d6a96e763 not found, creating... [ 651.042128] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.042128] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.042128] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.042128] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.042128] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.042128] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.042128] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.042128] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.043073] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.043127] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.043389] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 86d4188a-6ff8-4427-a8ca-1c8d6a96e763 is going to be created. [ 651.063795] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.064083] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.064818] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.065160] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.065409] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.065684] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-86d4188a-6ff8-4427-a8ca-1c8d6a96e763" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.173631] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e69c098-0604-4bc9-b238-58e7b66303f1 [ 651.176631] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.177648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.177648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.177944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.178422] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.178551] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e69c098-0604-4bc9-b238-58e7b66303f1 already deleted. [ 651.178715] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e69c098-0604-4bc9-b238-58e7b66303f1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.205682] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 884a937d-f25c-4b98-be12-acfbdb273d70 in Status: SUCCESS [ 651.206395] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 884a937d-f25c-4b98-be12-acfbdb273d70 deletion is rescheduled due to dependency. [ 651.206395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.284679] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80fea482-6d64-4937-892c-62371db01817: rpc.has_security_group_logging(os_id): False [ 651.300401] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.306430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.306430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.306430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.306430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.306430] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.306430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.306430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.306430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.306430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.306430] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80fea482-6d64-4937-892c-62371db01817 is going to be created. [ 651.363487] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.363628] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.363692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.366685] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.366685] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.373982] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80fea482-6d64-4937-892c-62371db01817 in Status: IN_PROGRESS for 2s [ 651.803333] env[68109]: INFO networking_nsxv3.common.synchronization [req-1a7e2839-9ac4-4567-b488-52a10b1c1758 req-55b66618-5a86-4a1a-8f80-bf40bfef1d43 service nova] Enqueued Resource ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 with Priority: HIGHEST for action security_group_rules [ 651.803333] env[68109]: INFO networking_nsxv3.common.synchronization [req-1a7e2839-9ac4-4567-b488-52a10b1c1758 req-55b66618-5a86-4a1a-8f80-bf40bfef1d43 service nova] Enqueued Resource ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 with Priority: HIGHEST for action security_group_members [ 651.803333] env[68109]: INFO networking_nsxv3.common.synchronization [req-1a7e2839-9ac4-4567-b488-52a10b1c1758 req-55b66618-5a86-4a1a-8f80-bf40bfef1d43 service nova] Enqueued Resource ID: 86d4188a-6ff8-4427-a8ca-1c8d6a96e763 with Priority: HIGHEST for action port [ 651.803762] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 with Priority: HIGHEST for action security_group_rules [ 651.803889] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 with Priority: HIGHEST for action security_group_members [ 651.803988] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86d4188a-6ff8-4427-a8ca-1c8d6a96e763 with Priority: HIGHEST for action port [ 651.808625] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14fbc65b-2397-4f06-bab2-162f42e5d290 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.808745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.808745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.808997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.809094] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14fbc65b-2397-4f06-bab2-162f42e5d290',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.810616] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-14fbc65b-2397-4f06-bab2-162f42e5d290 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.810767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.811041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.811096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.811232] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.811348] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.811419] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.811606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.811719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.811841] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14fbc65b-2397-4f06-bab2-162f42e5d290',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.813176] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-86d4188a-6ff8-4427-a8ca-1c8d6a96e763 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.813465] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86d4188a-6ff8-4427-a8ca-1c8d6a96e763" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.813465] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86d4188a-6ff8-4427-a8ca-1c8d6a96e763" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.813847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86d4188a-6ff8-4427-a8ca-1c8d6a96e763" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.814441] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86d4188a-6ff8-4427-a8ca-1c8d6a96e763',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.140021] env[68109]: INFO networking_nsxv3.common.synchronization [None req-4831a9f9-6ce3-4491-9218-f83d8e7af030 None None] Enqueued Resource ID: d832bacc-b682-4d7b-967d-8bcbc121aa48 with Priority: HIGHEST for action port [ 652.140021] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d832bacc-b682-4d7b-967d-8bcbc121aa48 with Priority: HIGHEST for action port [ 652.140021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-d832bacc-b682-4d7b-967d-8bcbc121aa48 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.140021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d832bacc-b682-4d7b-967d-8bcbc121aa48" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.140021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d832bacc-b682-4d7b-967d-8bcbc121aa48" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.140021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d832bacc-b682-4d7b-967d-8bcbc121aa48" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.140021] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d832bacc-b682-4d7b-967d-8bcbc121aa48',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.316842] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14fbc65b-2397-4f06-bab2-162f42e5d290',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.318683] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-14fbc65b-2397-4f06-bab2-162f42e5d290 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.318799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.318975] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86d4188a-6ff8-4427-a8ca-1c8d6a96e763 with status ACTIVE [ 652.319239] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.319892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.319990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.320312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.320462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.320524] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.320758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.320758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.320842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.320903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.321094] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.321278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.321278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.321396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.321482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.321526] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86d4188a-6ff8-4427-a8ca-1c8d6a96e763 is going to be updated. [ 652.345046] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.345197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.345238] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.345465] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.345576] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.345730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86d4188a-6ff8-4427-a8ca-1c8d6a96e763" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.648928] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d832bacc-b682-4d7b-967d-8bcbc121aa48 [ 652.649220] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.649369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.649438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.649647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.649739] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.649834] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d832bacc-b682-4d7b-967d-8bcbc121aa48 already deleted. [ 652.649915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d832bacc-b682-4d7b-967d-8bcbc121aa48" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.827432] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14fbc65b-2397-4f06-bab2-162f42e5d290',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.329273] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.329593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.329593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.329717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.329774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.329870] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 is going to be created. [ 653.352274] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.353106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.353106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.353106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.353106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.361488] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 in Status: UNINITIALIZED for 2s [ 653.384318] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80fea482-6d64-4937-892c-62371db01817 in Status: SUCCESS [ 653.384318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.766431] env[68109]: INFO networking_nsxv3.common.synchronization [req-3d4d9fd7-6fe8-40d2-95d1-8a8e7801c4b3 req-3d5fd421-a1bc-40f7-8e81-340b829d7772 tempest-SecurityGroupRulesNegativeTestJSON-204208813 tempest-SecurityGroupRulesNegativeTestJSON-204208813-project-member] Enqueued Resource ID: 444c6429-ea91-4736-b886-e05693904bd4 with Priority: HIGHEST for action security_group_rules [ 653.767072] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444c6429-ea91-4736-b886-e05693904bd4 with Priority: HIGHEST for action security_group_rules [ 653.767299] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-444c6429-ea91-4736-b886-e05693904bd4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.767451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-444c6429-ea91-4736-b886-e05693904bd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.767504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-444c6429-ea91-4736-b886-e05693904bd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.767736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-444c6429-ea91-4736-b886-e05693904bd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.767821] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('444c6429-ea91-4736-b886-e05693904bd4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.287457] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.288283] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.288283] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.288283] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.288440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.288473] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 444c6429-ea91-4736-b886-e05693904bd4 already deleted. [ 654.288551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-444c6429-ea91-4736-b886-e05693904bd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.971865] env[68109]: INFO networking_nsxv3.common.synchronization [req-3f1e369a-b9a0-4623-98ca-cdaa803773a6 req-f2b5db75-4095-4eda-980f-c898b719b920 tempest-ServersWithSpecificFlavorTestJSON-306442882 tempest-ServersWithSpecificFlavorTestJSON-306442882-project-member] Enqueued Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_members [ 654.972190] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_members [ 654.972556] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.972688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.972751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.972998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.974831] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.974831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.974831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.974831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.974831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.974831] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.375910] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 in Status: SUCCESS [ 655.376143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.376313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.376559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.376736] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.376852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.376928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.378047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.378179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.378283] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.378387] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14fbc65b-2397-4f06-bab2-162f42e5d290',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.477071] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.477234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.477300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.477524] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.477614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.477807] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.478075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.478075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.478248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.478248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.478337] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f already deleted. [ 655.478337] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.494006] env[68109]: INFO networking_nsxv3.common.synchronization [None req-e5c49c2f-59a7-4b86-a1c1-f3a3ad5351f2 None None] Enqueued Resource ID: 77fcdbf4-f155-445e-899d-0ffeea15f8ef with Priority: HIGHEST for action port [ 655.495394] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77fcdbf4-f155-445e-899d-0ffeea15f8ef with Priority: HIGHEST for action port [ 655.498583] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-77fcdbf4-f155-445e-899d-0ffeea15f8ef taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.498737] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77fcdbf4-f155-445e-899d-0ffeea15f8ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.499028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77fcdbf4-f155-445e-899d-0ffeea15f8ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.499093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77fcdbf4-f155-445e-899d-0ffeea15f8ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.499295] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77fcdbf4-f155-445e-899d-0ffeea15f8ef',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.558037] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.558037] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-61" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.558037] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-61" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.558037] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-61" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.558037] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.559552] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.559877] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.560268] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.561274] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.564808] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.564808] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.564808] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.564808] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.564808] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.564808] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.564808] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.597365] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.597529] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 655.598360] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.598360] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-61" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.598360] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-b7b4d366-f205-44b1-a9f3-a60074993424 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.598360] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-b7b4d366-f205-44b1-a9f3-a60074993424" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.598625] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-b7b4d366-f205-44b1-a9f3-a60074993424" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.599107] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-b7b4d366-f205-44b1-a9f3-a60074993424" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.599107] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7b4d366-f205-44b1-a9f3-a60074993424',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.883996] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-14fbc65b-2397-4f06-bab2-162f42e5d290 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.883996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.883996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.883996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.883996] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.883996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.883996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.883996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.883996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.883996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.883996] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-14fbc65b-2397-4f06-bab2-162f42e5d290 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.883996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.883996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.883996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.883996] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.883996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.884833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.884833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.884833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.884833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.884833] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14fbc65b-2397-4f06-bab2-162f42e5d290',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.001900] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77fcdbf4-f155-445e-899d-0ffeea15f8ef [ 656.002565] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.002565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.002565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.006246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.006246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.006246] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77fcdbf4-f155-445e-899d-0ffeea15f8ef already deleted. [ 656.006246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77fcdbf4-f155-445e-899d-0ffeea15f8ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.056185] env[68109]: INFO networking_nsxv3.common.synchronization [req-211312ad-9e5b-414e-98c3-50ce7c0189fb req-c579eab4-a8bd-4742-95e1-776d46f3db75 tempest-SecurityGroupRulesNegativeTestJSON-204208813 tempest-SecurityGroupRulesNegativeTestJSON-204208813-project-member] Enqueued Resource ID: 444c6429-ea91-4736-b886-e05693904bd4 with Priority: HIGHEST for action security_group_rules [ 656.057411] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444c6429-ea91-4736-b886-e05693904bd4 with Priority: HIGHEST for action security_group_rules [ 656.058023] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-444c6429-ea91-4736-b886-e05693904bd4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.058217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-444c6429-ea91-4736-b886-e05693904bd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.058441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-444c6429-ea91-4736-b886-e05693904bd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.064188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-444c6429-ea91-4736-b886-e05693904bd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.064188] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('444c6429-ea91-4736-b886-e05693904bd4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.104741] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.105510] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.105510] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.105510] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.105679] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.105788] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port b7b4d366-f205-44b1-a9f3-a60074993424 not found, creating... [ 656.106086] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.106355] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.106474] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.106717] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.106865] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.107224] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.107414] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.107533] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.108556] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.108874] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.109330] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: b7b4d366-f205-44b1-a9f3-a60074993424 is going to be created. [ 656.132336] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.132336] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.132336] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.135736] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.136094] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.137778] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-b7b4d366-f205-44b1-a9f3-a60074993424" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.393064] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14fbc65b-2397-4f06-bab2-162f42e5d290: rpc.has_security_group_logging(os_id): False [ 656.412706] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.416023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.416023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.416023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.416023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.416023] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.416023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.416023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.416023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.416023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.416023] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.416023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.416023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.416023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.416023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.416765] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.416765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.416765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.416765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.417694] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.417801] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 is going to be created. [ 656.512301] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.512477] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.513770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.513770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.513770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.524028] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 in Status: IN_PROGRESS for 2s [ 656.592951] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.592951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.592951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.592951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.592951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.592951] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 444c6429-ea91-4736-b886-e05693904bd4 already deleted. [ 656.592951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-444c6429-ea91-4736-b886-e05693904bd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.957015] env[68109]: INFO networking_nsxv3.common.synchronization [req-3f1e369a-b9a0-4623-98ca-cdaa803773a6 req-64bbe4b7-39ac-4b23-bcfb-abe8cdc9936d service nova] Enqueued Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_rules [ 656.957015] env[68109]: INFO networking_nsxv3.common.synchronization [req-3f1e369a-b9a0-4623-98ca-cdaa803773a6 req-64bbe4b7-39ac-4b23-bcfb-abe8cdc9936d service nova] Enqueued Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_members [ 656.957015] env[68109]: INFO networking_nsxv3.common.synchronization [req-3f1e369a-b9a0-4623-98ca-cdaa803773a6 req-64bbe4b7-39ac-4b23-bcfb-abe8cdc9936d service nova] Enqueued Resource ID: b7b4d366-f205-44b1-a9f3-a60074993424 with Priority: HIGHEST for action port [ 656.957015] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_rules [ 656.957015] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_members [ 656.957015] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7b4d366-f205-44b1-a9f3-a60074993424 with Priority: HIGHEST for action port [ 656.957015] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.957015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.958149] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.958633] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.958803] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.959814] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.960566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.960740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.961126] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.961372] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.962681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.962736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.962912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.963193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.963193] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.964350] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7b4d366-f205-44b1-a9f3-a60074993424 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.964350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7b4d366-f205-44b1-a9f3-a60074993424" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.964350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7b4d366-f205-44b1-a9f3-a60074993424" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.964350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7b4d366-f205-44b1-a9f3-a60074993424" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.964350] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7b4d366-f205-44b1-a9f3-a60074993424',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.231675] env[68109]: INFO networking_nsxv3.common.synchronization [req-ef6f1ec4-7286-4712-b44e-1ef71c22a8bf req-a3f1db38-9e03-43ce-b2a7-d16b9d710fca tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: d063caf8-0f34-48a0-8035-c8a07c90a01c with Priority: HIGHEST for action security_group_members [ 657.231675] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d063caf8-0f34-48a0-8035-c8a07c90a01c with Priority: HIGHEST for action security_group_members [ 657.231675] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-d063caf8-0f34-48a0-8035-c8a07c90a01c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.231675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.231675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.231675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.231675] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.231675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.231675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.231675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.231675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.231675] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d063caf8-0f34-48a0-8035-c8a07c90a01c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.410101] env[68109]: INFO networking_nsxv3.common.synchronization [None req-895493f3-df6b-4304-850f-744d245dc4e0 None None] Enqueued Resource ID: 5d0b8fbc-c54f-4f01-8185-736f040f1ea2 with Priority: HIGHEST for action port [ 657.410436] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0b8fbc-c54f-4f01-8185-736f040f1ea2 with Priority: HIGHEST for action port [ 657.411121] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d0b8fbc-c54f-4f01-8185-736f040f1ea2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.411267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d0b8fbc-c54f-4f01-8185-736f040f1ea2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.411322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d0b8fbc-c54f-4f01-8185-736f040f1ea2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.411571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d0b8fbc-c54f-4f01-8185-736f040f1ea2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.411651] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d0b8fbc-c54f-4f01-8185-736f040f1ea2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.468204] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.468204] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.468204] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.468995] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7b4d366-f205-44b1-a9f3-a60074993424 with status ACTIVE [ 657.469168] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.469303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.469380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.469586] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.469683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.470381] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.470381] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.470381] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.470381] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.470381] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.472513] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.472513] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.472513] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.472513] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.472513] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.472513] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7b4d366-f205-44b1-a9f3-a60074993424 is going to be updated. [ 657.492698] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.492896] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.492896] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.493128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.493280] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.493445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7b4d366-f205-44b1-a9f3-a60074993424" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.734533] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.734794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.734874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.735095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.735187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.735382] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.735481] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.735545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.735714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.735791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.735879] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d063caf8-0f34-48a0-8035-c8a07c90a01c already deleted. [ 657.735958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.737424] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.737424] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.737589] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.737813] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.738081] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.738263] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.738344] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.738795] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.739163] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.739562] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 657.739681] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.739783] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.740409] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.740409] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 657.740409] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.740409] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.758586] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.758586] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 657.758586] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.758586] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.759121] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-18dc42e8-352c-4960-a782-1034bbc0a806 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.759121] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-18dc42e8-352c-4960-a782-1034bbc0a806" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.759313] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-18dc42e8-352c-4960-a782-1034bbc0a806" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.759795] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-18dc42e8-352c-4960-a782-1034bbc0a806" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.759795] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18dc42e8-352c-4960-a782-1034bbc0a806',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.917456] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d0b8fbc-c54f-4f01-8185-736f040f1ea2 [ 657.917628] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.917738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.918054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.918350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.918746] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.918746] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d0b8fbc-c54f-4f01-8185-736f040f1ea2 already deleted. [ 657.918746] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d0b8fbc-c54f-4f01-8185-736f040f1ea2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.975319] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.265672] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.265987] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.266078] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.266474] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.266552] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.266720] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 18dc42e8-352c-4960-a782-1034bbc0a806 not found, creating... [ 658.267239] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.267239] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.267438] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.267875] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.267875] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.267999] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.269628] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.270032] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.270123] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.270286] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.270448] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 18dc42e8-352c-4960-a782-1034bbc0a806 is going to be created. [ 658.293524] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.293524] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.293524] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.293753] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.293908] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.294164] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-18dc42e8-352c-4960-a782-1034bbc0a806" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.478301] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.478493] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.478562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.478763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.478849] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.478944] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f is going to be created. [ 658.502747] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.502922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.502968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.503187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.503382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.512067] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f in Status: UNINITIALIZED for 2s [ 658.536321] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 in Status: SUCCESS [ 658.536585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.557143] env[68109]: INFO networking_nsxv3.common.synchronization [req-ef6f1ec4-7286-4712-b44e-1ef71c22a8bf req-ed48178d-efcc-4128-aae5-8b5187fb3d7c service nova] Enqueued Resource ID: d063caf8-0f34-48a0-8035-c8a07c90a01c with Priority: HIGHEST for action security_group_rules [ 659.557143] env[68109]: INFO networking_nsxv3.common.synchronization [req-ef6f1ec4-7286-4712-b44e-1ef71c22a8bf req-ed48178d-efcc-4128-aae5-8b5187fb3d7c service nova] Enqueued Resource ID: d063caf8-0f34-48a0-8035-c8a07c90a01c with Priority: HIGHEST for action security_group_members [ 659.557143] env[68109]: INFO networking_nsxv3.common.synchronization [req-ef6f1ec4-7286-4712-b44e-1ef71c22a8bf req-ed48178d-efcc-4128-aae5-8b5187fb3d7c service nova] Enqueued Resource ID: 18dc42e8-352c-4960-a782-1034bbc0a806 with Priority: HIGHEST for action port [ 659.557717] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d063caf8-0f34-48a0-8035-c8a07c90a01c with Priority: HIGHEST for action security_group_rules [ 659.559749] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d063caf8-0f34-48a0-8035-c8a07c90a01c with Priority: HIGHEST for action security_group_members [ 659.559749] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18dc42e8-352c-4960-a782-1034bbc0a806 with Priority: HIGHEST for action port [ 659.559749] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d063caf8-0f34-48a0-8035-c8a07c90a01c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.559749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.559749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.559749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.559749] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d063caf8-0f34-48a0-8035-c8a07c90a01c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.561222] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-d063caf8-0f34-48a0-8035-c8a07c90a01c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.561344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.561400] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.561593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.561760] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.563034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.563034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.563034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.563034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.563034] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d063caf8-0f34-48a0-8035-c8a07c90a01c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.563780] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-18dc42e8-352c-4960-a782-1034bbc0a806 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.563919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18dc42e8-352c-4960-a782-1034bbc0a806" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.563993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18dc42e8-352c-4960-a782-1034bbc0a806" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.564176] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18dc42e8-352c-4960-a782-1034bbc0a806" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.564243] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18dc42e8-352c-4960-a782-1034bbc0a806',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.700403] env[68109]: INFO networking_nsxv3.common.synchronization [None req-0d5060ab-265f-4aa6-8eff-5f61e1e4c836 None None] Enqueued Resource ID: c47aad1e-cc29-4920-950a-0db615132a35 with Priority: HIGHEST for action port [ 659.700674] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c47aad1e-cc29-4920-950a-0db615132a35 with Priority: HIGHEST for action port [ 659.701300] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-c47aad1e-cc29-4920-950a-0db615132a35 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.701421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c47aad1e-cc29-4920-950a-0db615132a35" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.701511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c47aad1e-cc29-4920-950a-0db615132a35" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.702063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c47aad1e-cc29-4920-950a-0db615132a35" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.702137] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c47aad1e-cc29-4920-950a-0db615132a35',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.066516] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-d063caf8-0f34-48a0-8035-c8a07c90a01c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.070019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.070019] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d063caf8-0f34-48a0-8035-c8a07c90a01c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.070019] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18dc42e8-352c-4960-a782-1034bbc0a806 with status ACTIVE [ 660.070019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.070019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.070019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.070019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.070019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.070019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.070019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.070019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.070019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.070019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.070019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.070019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.070019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.071873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.072000] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.072092] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18dc42e8-352c-4960-a782-1034bbc0a806 is going to be updated. [ 660.091815] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.093106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.093106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.093106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.093106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.093106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18dc42e8-352c-4960-a782-1034bbc0a806" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.206074] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c47aad1e-cc29-4920-950a-0db615132a35 [ 660.206074] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.206074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.206074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.206074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.206074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.206074] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c47aad1e-cc29-4920-950a-0db615132a35 already deleted. [ 660.206074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c47aad1e-cc29-4920-950a-0db615132a35" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.523014] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f in Status: SUCCESS [ 660.524916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.524916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.524916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.524916] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.524916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.524916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.524916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.524916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.524916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.524916] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.573746] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d063caf8-0f34-48a0-8035-c8a07c90a01c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.033857] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.077584] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.077584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.077584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.077584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.077584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.077584] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d063caf8-0f34-48a0-8035-c8a07c90a01c is going to be created. [ 661.099072] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.099072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.099072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.099072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.100755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.112733] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d063caf8-0f34-48a0-8035-c8a07c90a01c in Status: UNINITIALIZED for 2s [ 661.344332] env[68109]: INFO networking_nsxv3.common.synchronization [None req-515a32f7-a133-4e4e-bc38-c1e96b9236bb None None] Enqueued Resource ID: c2e7a814-abd7-42c6-a5e4-df6ccc356731 with Priority: HIGHEST for action port [ 661.344332] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2e7a814-abd7-42c6-a5e4-df6ccc356731 with Priority: HIGHEST for action port [ 661.344332] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2e7a814-abd7-42c6-a5e4-df6ccc356731 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.344332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2e7a814-abd7-42c6-a5e4-df6ccc356731" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.344332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2e7a814-abd7-42c6-a5e4-df6ccc356731" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.344332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2e7a814-abd7-42c6-a5e4-df6ccc356731" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.344332] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2e7a814-abd7-42c6-a5e4-df6ccc356731',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.537922] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1b52ab9-23fb-4785-af13-8d3e64d2b62f: rpc.has_security_group_logging(os_id): False [ 661.560041] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.560041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.560041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.560302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.560550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.560629] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.560738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.560800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.560971] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.561068] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.561156] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f is going to be created. [ 661.620589] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.620976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.620976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.622799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.622799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.646995] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f in Status: IN_PROGRESS for 2s [ 661.850901] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2e7a814-abd7-42c6-a5e4-df6ccc356731 [ 661.850901] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.850901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.850901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.850901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.850901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.850901] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2e7a814-abd7-42c6-a5e4-df6ccc356731 already deleted. [ 661.850901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2e7a814-abd7-42c6-a5e4-df6ccc356731" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.325025] env[68109]: INFO networking_nsxv3.common.synchronization [None req-5ef8fb36-c7d1-48c4-883a-6ba5b0f8b8aa None None] Enqueued Resource ID: b7ff3df2-c10a-476b-ad0e-062477314132 with Priority: HIGHEST for action port [ 662.325025] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7ff3df2-c10a-476b-ad0e-062477314132 with Priority: HIGHEST for action port [ 662.325551] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7ff3df2-c10a-476b-ad0e-062477314132 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.325672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7ff3df2-c10a-476b-ad0e-062477314132" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.325733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7ff3df2-c10a-476b-ad0e-062477314132" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.326041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7ff3df2-c10a-476b-ad0e-062477314132" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.326902] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7ff3df2-c10a-476b-ad0e-062477314132',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.535448] env[68109]: INFO networking_nsxv3.common.synchronization [None req-fb1c9aa2-0cb0-403d-a35c-eef910c5f816 None None] Enqueued Resource ID: ef010016-4cb9-4e48-85d0-04b094b19e9e with Priority: HIGHEST for action port [ 662.535448] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef010016-4cb9-4e48-85d0-04b094b19e9e with Priority: HIGHEST for action port [ 662.535448] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef010016-4cb9-4e48-85d0-04b094b19e9e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.535448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef010016-4cb9-4e48-85d0-04b094b19e9e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.535448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef010016-4cb9-4e48-85d0-04b094b19e9e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.535823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef010016-4cb9-4e48-85d0-04b094b19e9e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.536560] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef010016-4cb9-4e48-85d0-04b094b19e9e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.831789] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7ff3df2-c10a-476b-ad0e-062477314132 [ 662.831789] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.831789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.831789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.831789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.831789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.831789] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7ff3df2-c10a-476b-ad0e-062477314132 already deleted. [ 662.831789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7ff3df2-c10a-476b-ad0e-062477314132" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.039334] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef010016-4cb9-4e48-85d0-04b094b19e9e [ 663.039682] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.039817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.039886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.042269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.042269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.042269] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef010016-4cb9-4e48-85d0-04b094b19e9e already deleted. [ 663.042269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef010016-4cb9-4e48-85d0-04b094b19e9e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.123358] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d063caf8-0f34-48a0-8035-c8a07c90a01c in Status: SUCCESS [ 663.123636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.124241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.124475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.124671] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.124789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.124852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.125014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.125101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.125190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.125274] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d063caf8-0f34-48a0-8035-c8a07c90a01c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.628244] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d063caf8-0f34-48a0-8035-c8a07c90a01c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.661310] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f in Status: SUCCESS [ 663.661310] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.892033] env[68109]: INFO networking_nsxv3.common.synchronization [req-14c885fa-f23f-4806-aeef-4675d5955a84 req-3cd48c5b-a327-435b-ab75-e5be3d8179b8 tempest-ServersTestJSON-881419211 tempest-ServersTestJSON-881419211-project-member] Enqueued Resource ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 with Priority: HIGHEST for action security_group_members [ 663.892652] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 with Priority: HIGHEST for action security_group_members [ 663.894053] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.897201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.897201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.897201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.897201] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.897201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.897201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.897201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.897201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.897201] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.132434] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d063caf8-0f34-48a0-8035-c8a07c90a01c: rpc.has_security_group_logging(os_id): False [ 664.149767] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.150193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.150193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.150331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.150331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.150548] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.150651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.150748] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.150878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.150976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.151086] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d063caf8-0f34-48a0-8035-c8a07c90a01c is going to be created. [ 664.208860] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.209029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.209079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.210897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.210897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.221501] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d063caf8-0f34-48a0-8035-c8a07c90a01c in Status: IN_PROGRESS for 2s [ 664.400426] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.400707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.400707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.401279] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.401279] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.401279] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.401279] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.401558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.401558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.401558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.401792] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 already deleted. [ 664.401792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.660438] env[68109]: INFO networking_nsxv3.common.synchronization [None req-f4f7e24c-8451-4d8e-b906-82a83b250ac3 None None] Enqueued Resource ID: 27f15692-a48f-4521-9016-69e5694522a8 with Priority: HIGHEST for action port [ 664.660981] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27f15692-a48f-4521-9016-69e5694522a8 with Priority: HIGHEST for action port [ 664.661362] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-27f15692-a48f-4521-9016-69e5694522a8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.661541] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27f15692-a48f-4521-9016-69e5694522a8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.661541] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27f15692-a48f-4521-9016-69e5694522a8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.662029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27f15692-a48f-4521-9016-69e5694522a8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.662029] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27f15692-a48f-4521-9016-69e5694522a8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.739667] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-276 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.739907] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-276" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.740141] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-276" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.740514] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-276" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.740814] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.741022] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.743051] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.743468] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.744070] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.744398] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.744534] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.745354] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.745566] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.745712] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.745850] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.746025] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.765972] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.766164] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 664.766306] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.766498] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-276" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.766820] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-a03d6a04-6c48-40c0-babe-beb89a4a5f89 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.766999] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-a03d6a04-6c48-40c0-babe-beb89a4a5f89" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.767134] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-a03d6a04-6c48-40c0-babe-beb89a4a5f89" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.767582] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-a03d6a04-6c48-40c0-babe-beb89a4a5f89" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.768135] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a03d6a04-6c48-40c0-babe-beb89a4a5f89',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.903322] env[68109]: INFO networking_nsxv3.common.synchronization [None req-cbfd0e99-4ece-4e93-b4eb-854a173d33da None None] Enqueued Resource ID: 0ef2ff60-a77c-43e9-b66d-95476b27fbec with Priority: HIGHEST for action port [ 664.904299] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ef2ff60-a77c-43e9-b66d-95476b27fbec with Priority: HIGHEST for action port [ 664.904299] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ef2ff60-a77c-43e9-b66d-95476b27fbec taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.904727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ef2ff60-a77c-43e9-b66d-95476b27fbec" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.904727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ef2ff60-a77c-43e9-b66d-95476b27fbec" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.905056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ef2ff60-a77c-43e9-b66d-95476b27fbec" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.905152] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ef2ff60-a77c-43e9-b66d-95476b27fbec',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.166462] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27f15692-a48f-4521-9016-69e5694522a8 [ 665.166756] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.166902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.166970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.167238] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.167316] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.167420] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27f15692-a48f-4521-9016-69e5694522a8 already deleted. [ 665.167525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27f15692-a48f-4521-9016-69e5694522a8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.270462] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.270846] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.270970] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.271265] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.271447] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.271593] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port a03d6a04-6c48-40c0-babe-beb89a4a5f89 not found, creating... [ 665.271874] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.272085] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.272163] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.274058] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.274058] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.274058] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.274058] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.277106] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.277499] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.277938] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.277938] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: a03d6a04-6c48-40c0-babe-beb89a4a5f89 is going to be created. [ 665.283610] env[68109]: INFO networking_nsxv3.common.synchronization [None req-dfcd3b2b-85d6-4b8c-ab8a-fcec7a7f0031 tempest-ServersTestBootFromVolume-1173265696 tempest-ServersTestBootFromVolume-1173265696-project-member] Enqueued Resource ID: 817904c7-035a-41ce-bf21-c0db158c7bea with Priority: HIGHEST for action security_group_rules [ 665.283610] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 817904c7-035a-41ce-bf21-c0db158c7bea with Priority: HIGHEST for action security_group_rules [ 665.283930] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-817904c7-035a-41ce-bf21-c0db158c7bea taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.285191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.285191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.285191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.285191] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('817904c7-035a-41ce-bf21-c0db158c7bea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.296811] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.296989] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.297155] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.297434] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.297675] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.297896] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-a03d6a04-6c48-40c0-babe-beb89a4a5f89" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.408228] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ef2ff60-a77c-43e9-b66d-95476b27fbec [ 665.409120] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.409287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.409392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.409609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.409702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.409801] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ef2ff60-a77c-43e9-b66d-95476b27fbec already deleted. [ 665.409885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ef2ff60-a77c-43e9-b66d-95476b27fbec" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.428538] env[68109]: INFO networking_nsxv3.common.synchronization [None req-5825e5d8-a9c4-4cf9-8716-2a64baaf3c18 tempest-ServersTestBootFromVolume-1173265696 tempest-ServersTestBootFromVolume-1173265696-project-member] Enqueued Resource ID: 817904c7-035a-41ce-bf21-c0db158c7bea with Priority: HIGHEST for action security_group_rules [ 665.429022] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 817904c7-035a-41ce-bf21-c0db158c7bea with Priority: HIGHEST for action security_group_rules [ 665.433845] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-817904c7-035a-41ce-bf21-c0db158c7bea taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.433845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.807213] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.807379] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.807455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.807829] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.807980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.808521] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 817904c7-035a-41ce-bf21-c0db158c7bea already deleted. [ 665.808629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.809765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.809765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.809765] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('817904c7-035a-41ce-bf21-c0db158c7bea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.018412] env[68109]: INFO networking_nsxv3.common.synchronization [req-14c885fa-f23f-4806-aeef-4675d5955a84 req-52e34e02-df84-4af5-8961-35d4dd1ce84c service nova] Enqueued Resource ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 with Priority: HIGHEST for action security_group_rules [ 666.018684] env[68109]: INFO networking_nsxv3.common.synchronization [req-14c885fa-f23f-4806-aeef-4675d5955a84 req-52e34e02-df84-4af5-8961-35d4dd1ce84c service nova] Enqueued Resource ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 with Priority: HIGHEST for action security_group_members [ 666.018684] env[68109]: INFO networking_nsxv3.common.synchronization [req-14c885fa-f23f-4806-aeef-4675d5955a84 req-52e34e02-df84-4af5-8961-35d4dd1ce84c service nova] Enqueued Resource ID: a03d6a04-6c48-40c0-babe-beb89a4a5f89 with Priority: HIGHEST for action port [ 666.019231] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 with Priority: HIGHEST for action security_group_rules [ 666.019397] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 with Priority: HIGHEST for action security_group_members [ 666.019494] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03d6a04-6c48-40c0-babe-beb89a4a5f89 with Priority: HIGHEST for action port [ 666.021550] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.021550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.021550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.021550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.021550] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.023174] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.023343] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.023393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.023866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.023866] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.023990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.023990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.024757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.024757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.024757] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.028556] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-a03d6a04-6c48-40c0-babe-beb89a4a5f89 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.028556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a03d6a04-6c48-40c0-babe-beb89a4a5f89" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.028556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a03d6a04-6c48-40c0-babe-beb89a4a5f89" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.028556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a03d6a04-6c48-40c0-babe-beb89a4a5f89" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.028556] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a03d6a04-6c48-40c0-babe-beb89a4a5f89',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.237400] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d063caf8-0f34-48a0-8035-c8a07c90a01c in Status: SUCCESS [ 666.237400] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.328891] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.328891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.328891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.328891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.328891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.328891] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 817904c7-035a-41ce-bf21-c0db158c7bea already deleted. [ 666.328891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.529550] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.529550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.532740] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.534045] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a03d6a04-6c48-40c0-babe-beb89a4a5f89 with status ACTIVE [ 666.534870] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.535533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.535744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.536092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.536386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.536772] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.537147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.537357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.540691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.540691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.540691] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.540691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.540691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.540691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.540691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.540691] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a03d6a04-6c48-40c0-babe-beb89a4a5f89 is going to be updated. [ 666.576647] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.576801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.576859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.577178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.577244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.577398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a03d6a04-6c48-40c0-babe-beb89a4a5f89" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.042076] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.549138] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.549138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.549138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.549138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.549138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.549138] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 is going to be created. [ 667.571902] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.571902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.571902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.571902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.571902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.579929] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 in Status: UNINITIALIZED for 2s [ 667.873824] env[68109]: INFO networking_nsxv3.common.synchronization [None req-1fc1298b-9502-44aa-9d98-3103b40beca2 None None] Enqueued Resource ID: 5b647fd9-5f16-4706-87bd-529cf0201c29 with Priority: HIGHEST for action port [ 667.873824] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b647fd9-5f16-4706-87bd-529cf0201c29 with Priority: HIGHEST for action port [ 667.873824] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b647fd9-5f16-4706-87bd-529cf0201c29 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.873824] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b647fd9-5f16-4706-87bd-529cf0201c29" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.873824] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b647fd9-5f16-4706-87bd-529cf0201c29" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.874362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b647fd9-5f16-4706-87bd-529cf0201c29" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.874362] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b647fd9-5f16-4706-87bd-529cf0201c29',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.237805] env[68109]: INFO networking_nsxv3.common.synchronization [req-5bd6a221-86a3-44d3-9b93-b4d087155171 req-7c061c00-8fc1-4cf4-a9dc-94fd99828a5b tempest-ServerDiagnosticsTest-8702156 tempest-ServerDiagnosticsTest-8702156-project-member] Enqueued Resource ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 with Priority: HIGHEST for action security_group_members [ 668.238627] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 with Priority: HIGHEST for action security_group_members [ 668.238883] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-14fbc65b-2397-4f06-bab2-162f42e5d290 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.239061] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.239156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.239369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.239531] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.239648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.239713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.239894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.239984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.240333] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14fbc65b-2397-4f06-bab2-162f42e5d290',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.377270] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b647fd9-5f16-4706-87bd-529cf0201c29 [ 668.377611] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.378145] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.378219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.378878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.378998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.379271] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b647fd9-5f16-4706-87bd-529cf0201c29 already deleted. [ 668.379390] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b647fd9-5f16-4706-87bd-529cf0201c29" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.745533] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.745705] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.745773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.746006] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.746114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.746399] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.746512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.746750] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.746831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.746878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.746965] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 is going to be updated. [ 668.776681] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.777048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.777048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.777280] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.777402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.785400] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 in Status: IN_PROGRESS for 2s [ 669.590273] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 in Status: SUCCESS [ 669.590273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.590273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.590666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.590666] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.590770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.590828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.590996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.591090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.591176] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.591269] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.988844] env[68109]: INFO networking_nsxv3.common.synchronization [None req-d2d0fb2d-30c9-4361-a4eb-63c9f3d4c8af None None] Enqueued Resource ID: 3a3a2b35-6742-4511-aead-ce058a42ebb2 with Priority: HIGHEST for action port [ 669.989554] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a3a2b35-6742-4511-aead-ce058a42ebb2 with Priority: HIGHEST for action port [ 669.991468] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a3a2b35-6742-4511-aead-ce058a42ebb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.991813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a3a2b35-6742-4511-aead-ce058a42ebb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.991874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a3a2b35-6742-4511-aead-ce058a42ebb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.992209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a3a2b35-6742-4511-aead-ce058a42ebb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.992392] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a3a2b35-6742-4511-aead-ce058a42ebb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.095525] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.404577] env[68109]: INFO networking_nsxv3.common.synchronization [req-728fb3da-2dd9-43a2-8459-bdcfc6e2721f req-5a2132c6-f769-46f9-a928-8903e86d0cea tempest-AttachVolumeShelveTestJSON-1309092891 tempest-AttachVolumeShelveTestJSON-1309092891-project-member] Enqueued Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_members [ 670.409450] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_members [ 670.412665] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-50bf3a02-de03-46e5-a1de-389d8f706b9b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.412665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.412665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.412665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.412665] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.412665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.412665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.412665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.412665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.413224] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.499392] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a3a2b35-6742-4511-aead-ce058a42ebb2 [ 670.499624] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.499759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.499824] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.500049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.500138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.500227] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a3a2b35-6742-4511-aead-ce058a42ebb2 already deleted. [ 670.500308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a3a2b35-6742-4511-aead-ce058a42ebb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.523996] env[68109]: INFO networking_nsxv3.common.synchronization [req-9f020e2a-6bf8-4c75-8102-7fd9990b785e req-62cae43b-01b6-47b9-8a08-14011033e8fc tempest-ServerDiskConfigTestJSON-1064584538 tempest-ServerDiskConfigTestJSON-1064584538-project-member] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 670.526354] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 670.526354] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.526354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.526354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.526354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.526354] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.526354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.526901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.526901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.526901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.526901] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.603041] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2: rpc.has_security_group_logging(os_id): False [ 670.621538] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.621538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.621538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.621749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.621852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.622133] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.622242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.626516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.627612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.628540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.628540] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 is going to be created. [ 670.698422] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.699042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.699042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.699042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.699286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.711424] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 in Status: IN_PROGRESS for 2s [ 670.797703] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 in Status: SUCCESS [ 670.797855] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 deletion is rescheduled due to dependency. [ 670.798161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.915722] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.916710] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.916916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.917257] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.918374] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.918738] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.919099] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.920028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.920028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.920028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.920028] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b already deleted. [ 670.920028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.032202] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.032568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.032568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.032839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.032839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.033140] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.033886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.033886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.033886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.033886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.033886] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 671.068502] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.068768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.068768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.069174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.069273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.084262] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 671.319189] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.319189] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.319189] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.319771] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.320236] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.320923] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.323025] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.323025] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.323025] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.323025] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.323025] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.323025] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.323025] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.323025] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.323025] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.323025] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.343172] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.343172] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 671.343172] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.343172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.343172] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.343172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.343172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.343172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.343172] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.849224] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.849593] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.849593] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.850033] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.850033] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.850147] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 not found, creating... [ 671.850514] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.850698] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.850795] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.850985] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.851152] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.852177] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.852533] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.852605] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.852871] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.853064] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.853399] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 is going to be created. [ 671.890718] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.890971] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.891350] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.891706] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.891706] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.891882] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.601049] env[68109]: INFO networking_nsxv3.common.synchronization [None req-1040f8bc-7049-45a8-9336-d202fae64a76 None None] Enqueued Resource ID: 0aa37c9c-6e23-4cf3-a201-30e3bb87ca6c with Priority: HIGHEST for action port [ 672.602109] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aa37c9c-6e23-4cf3-a201-30e3bb87ca6c with Priority: HIGHEST for action port [ 672.602109] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0aa37c9c-6e23-4cf3-a201-30e3bb87ca6c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.602109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0aa37c9c-6e23-4cf3-a201-30e3bb87ca6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.602109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0aa37c9c-6e23-4cf3-a201-30e3bb87ca6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.602497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0aa37c9c-6e23-4cf3-a201-30e3bb87ca6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.602497] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aa37c9c-6e23-4cf3-a201-30e3bb87ca6c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.723599] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 in Status: SUCCESS [ 672.723851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.094077] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 673.094383] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 deletion is rescheduled due to dependency. [ 673.094383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.104899] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0aa37c9c-6e23-4cf3-a201-30e3bb87ca6c [ 673.105313] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.105313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.105542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.105595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.106201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.106201] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0aa37c9c-6e23-4cf3-a201-30e3bb87ca6c already deleted. [ 673.106201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0aa37c9c-6e23-4cf3-a201-30e3bb87ca6c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.187991] env[68109]: INFO networking_nsxv3.common.synchronization [req-728fb3da-2dd9-43a2-8459-bdcfc6e2721f req-e336f9b8-4db4-4a86-8498-dec325708fa2 service nova] Enqueued Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_rules [ 673.187991] env[68109]: INFO networking_nsxv3.common.synchronization [req-728fb3da-2dd9-43a2-8459-bdcfc6e2721f req-e336f9b8-4db4-4a86-8498-dec325708fa2 service nova] Enqueued Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_members [ 673.187991] env[68109]: INFO networking_nsxv3.common.synchronization [req-728fb3da-2dd9-43a2-8459-bdcfc6e2721f req-e336f9b8-4db4-4a86-8498-dec325708fa2 service nova] Enqueued Resource ID: f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 with Priority: HIGHEST for action port [ 673.188230] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_rules [ 673.190352] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_members [ 673.190352] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 with Priority: HIGHEST for action port [ 673.190352] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50bf3a02-de03-46e5-a1de-389d8f706b9b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.190352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.190352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.190352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.190352] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.190783] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-50bf3a02-de03-46e5-a1de-389d8f706b9b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.190783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.190783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.190960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.191105] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.191185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.191231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.191392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.191548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.191607] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.192349] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.192475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.192517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.192659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.192734] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.692317] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-50bf3a02-de03-46e5-a1de-389d8f706b9b taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.692317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.697096] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 with status ACTIVE [ 673.697096] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.697310] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.697310] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.697547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.698185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.698185] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.698185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.698185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.698617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.698709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.699093] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.700032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.700032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.700032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.700032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.700032] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 is going to be updated. [ 673.701374] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.733152] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.733325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.733395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.733647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.733785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.733991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.205670] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.711517] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.711517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.711517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.711517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.711517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.711517] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b is going to be created. [ 674.736056] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.736056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.736056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.736056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.736056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.744457] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b in Status: UNINITIALIZED for 2s [ 675.008123] env[68109]: INFO networking_nsxv3.common.synchronization [None req-f93d8ec7-c7e0-4140-a6aa-443c42cf6d69 None None] Enqueued Resource ID: 42398894-e7de-4e63-9bb1-7c230536f854 with Priority: HIGHEST for action port [ 675.008364] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42398894-e7de-4e63-9bb1-7c230536f854 with Priority: HIGHEST for action port [ 675.008731] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-42398894-e7de-4e63-9bb1-7c230536f854 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.015031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42398894-e7de-4e63-9bb1-7c230536f854" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.015031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42398894-e7de-4e63-9bb1-7c230536f854" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.015031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42398894-e7de-4e63-9bb1-7c230536f854" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.015031] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42398894-e7de-4e63-9bb1-7c230536f854',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.519368] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42398894-e7de-4e63-9bb1-7c230536f854 [ 675.519632] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.519783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.519852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.520073] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.520165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.520263] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42398894-e7de-4e63-9bb1-7c230536f854 already deleted. [ 675.520436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42398894-e7de-4e63-9bb1-7c230536f854" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.754475] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b in Status: SUCCESS [ 676.754760] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.754970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.755196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.755400] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.755611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.755676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.755836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.755914] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.755997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.756097] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.245277] env[68109]: INFO networking_nsxv3.common.synchronization [req-8b3d909e-e7f2-44c3-9c0e-cb2516071de5 req-956257b4-3df0-4998-a60e-1c37638c8331 tempest-DeleteServersAdminTestJSON-886050253 tempest-DeleteServersAdminTestJSON-886050253-project-member] Enqueued Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_members [ 677.246200] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_members [ 677.247453] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.247453] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.247453] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.247453] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.247453] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.247453] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.247674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.247705] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.248471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.248471] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.258341] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.751115] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.751115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.751115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.751115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.751629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.751629] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.751629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.751629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.751829] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.751829] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.751900] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 is going to be updated. [ 677.765237] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50bf3a02-de03-46e5-a1de-389d8f706b9b: rpc.has_security_group_logging(os_id): False [ 677.782241] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.782693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.782801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.783070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.783309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.783693] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.784143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.784240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.784471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.785014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.785014] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b is going to be created. [ 677.797407] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.797549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.797620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.797820] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.797968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.807591] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 in Status: IN_PROGRESS for 2s [ 677.846435] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.846668] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.846668] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.846895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.847115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.862018] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b in Status: IN_PROGRESS for 2s [ 678.253286] env[68109]: INFO networking_nsxv3.common.synchronization [None req-c5fe5adb-f92b-44a3-a480-de89b7ceb540 None None] Enqueued Resource ID: ddbd6888-c25b-40ac-b0a4-0eeb8166f5fe with Priority: HIGHEST for action port [ 678.253286] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddbd6888-c25b-40ac-b0a4-0eeb8166f5fe with Priority: HIGHEST for action port [ 678.253286] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddbd6888-c25b-40ac-b0a4-0eeb8166f5fe taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.254251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddbd6888-c25b-40ac-b0a4-0eeb8166f5fe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.254517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddbd6888-c25b-40ac-b0a4-0eeb8166f5fe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.255081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddbd6888-c25b-40ac-b0a4-0eeb8166f5fe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.255510] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddbd6888-c25b-40ac-b0a4-0eeb8166f5fe',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.415789] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.415789] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.415789] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.416734] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.417740] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.417740] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.418606] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.418606] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.418857] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.419192] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.419713] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.419713] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.420922] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.420922] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.420922] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.420922] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.448197] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.448197] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 678.448197] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.448197] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.448197] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-f1b74c52-1c1d-4aaa-a17d-539f3e38ef50 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.448197] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-f1b74c52-1c1d-4aaa-a17d-539f3e38ef50" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.448197] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-f1b74c52-1c1d-4aaa-a17d-539f3e38ef50" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.448197] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-f1b74c52-1c1d-4aaa-a17d-539f3e38ef50" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.448197] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1b74c52-1c1d-4aaa-a17d-539f3e38ef50',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.744133] env[68109]: INFO networking_nsxv3.common.synchronization [None req-b1e5b86d-4e1f-4b51-96c6-33ff6da88342 None None] Enqueued Resource ID: 2022575e-1997-43ac-a197-e34b94bb6acb with Priority: HIGHEST for action port [ 678.744318] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2022575e-1997-43ac-a197-e34b94bb6acb with Priority: HIGHEST for action port [ 678.744909] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-2022575e-1997-43ac-a197-e34b94bb6acb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.745052] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2022575e-1997-43ac-a197-e34b94bb6acb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.745123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2022575e-1997-43ac-a197-e34b94bb6acb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.745364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2022575e-1997-43ac-a197-e34b94bb6acb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.745532] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2022575e-1997-43ac-a197-e34b94bb6acb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.758841] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddbd6888-c25b-40ac-b0a4-0eeb8166f5fe [ 678.759335] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.759639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.759834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.760436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.760436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.760436] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddbd6888-c25b-40ac-b0a4-0eeb8166f5fe already deleted. [ 678.760436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddbd6888-c25b-40ac-b0a4-0eeb8166f5fe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.917175] env[68109]: INFO networking_nsxv3.common.synchronization [None req-383c230f-00b4-4812-b615-ce244e33b3be None None] Enqueued Resource ID: e797f805-7ef6-467b-ba8b-9482d3238ced with Priority: HIGHEST for action port [ 678.917475] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e797f805-7ef6-467b-ba8b-9482d3238ced with Priority: HIGHEST for action port [ 678.918017] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-e797f805-7ef6-467b-ba8b-9482d3238ced taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.918154] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e797f805-7ef6-467b-ba8b-9482d3238ced" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.918321] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e797f805-7ef6-467b-ba8b-9482d3238ced" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.918445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e797f805-7ef6-467b-ba8b-9482d3238ced" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.918523] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e797f805-7ef6-467b-ba8b-9482d3238ced',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.956648] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.957555] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.957555] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.957555] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.957555] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.957555] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port f1b74c52-1c1d-4aaa-a17d-539f3e38ef50 not found, creating... [ 678.958095] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.958095] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.958095] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.958290] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.958552] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.958741] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.958837] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.959034] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.959231] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.959351] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.959492] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: f1b74c52-1c1d-4aaa-a17d-539f3e38ef50 is going to be created. [ 678.980401] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.980401] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.980401] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.980401] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.980895] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.980895] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-f1b74c52-1c1d-4aaa-a17d-539f3e38ef50" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.248765] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2022575e-1997-43ac-a197-e34b94bb6acb [ 679.248765] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.248765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.248765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.248765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.248765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.248765] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2022575e-1997-43ac-a197-e34b94bb6acb already deleted. [ 679.248765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2022575e-1997-43ac-a197-e34b94bb6acb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.423688] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e797f805-7ef6-467b-ba8b-9482d3238ced [ 679.423688] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.423895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.423895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.424349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.424349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.424349] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e797f805-7ef6-467b-ba8b-9482d3238ced already deleted. [ 679.424349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e797f805-7ef6-467b-ba8b-9482d3238ced" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.817325] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 in Status: SUCCESS [ 679.817587] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 deletion is rescheduled due to dependency. [ 679.817715] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.875092] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b in Status: SUCCESS [ 679.875351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.199493] env[68109]: INFO networking_nsxv3.common.synchronization [req-9cb2a2c9-ad99-4c97-b3f3-de063f5f1112 req-118ba92c-1dcb-4875-b8a2-08613b82ccf8 tempest-ServerActionsTestOtherB-1748290489 tempest-ServerActionsTestOtherB-1748290489-project-member] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 680.200400] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 680.200400] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.200601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.200601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.200764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.200914] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.201059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.201130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.201922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.201922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.202038] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.507340] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-535 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.507533] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.507660] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.507964] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.508318] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.508849] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.508981] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.510032] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.510032] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.510032] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.510032] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.510032] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.510032] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.510032] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.510316] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.510316] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.529290] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.529290] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 680.529290] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.529411] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.529670] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-73a714ef-b157-4072-a032-e9b77adf890a taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.529845] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-73a714ef-b157-4072-a032-e9b77adf890a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.529963] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-73a714ef-b157-4072-a032-e9b77adf890a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.530309] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-73a714ef-b157-4072-a032-e9b77adf890a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.530453] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73a714ef-b157-4072-a032-e9b77adf890a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.669239] env[68109]: INFO networking_nsxv3.common.synchronization [req-8b3d909e-e7f2-44c3-9c0e-cb2516071de5 req-b05e8a96-351c-4250-801c-a0f710d8abac service nova] Enqueued Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_rules [ 680.669431] env[68109]: INFO networking_nsxv3.common.synchronization [req-8b3d909e-e7f2-44c3-9c0e-cb2516071de5 req-b05e8a96-351c-4250-801c-a0f710d8abac service nova] Enqueued Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_members [ 680.669568] env[68109]: INFO networking_nsxv3.common.synchronization [req-8b3d909e-e7f2-44c3-9c0e-cb2516071de5 req-b05e8a96-351c-4250-801c-a0f710d8abac service nova] Enqueued Resource ID: f1b74c52-1c1d-4aaa-a17d-539f3e38ef50 with Priority: HIGHEST for action port [ 680.670271] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_rules [ 680.670545] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_members [ 680.670667] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1b74c52-1c1d-4aaa-a17d-539f3e38ef50 with Priority: HIGHEST for action port [ 680.670945] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.671539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.671615] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.671820] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.671903] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.672854] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.672967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.673046] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.673212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.673749] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.673851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.673917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.674078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.674421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.674558] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.675508] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1b74c52-1c1d-4aaa-a17d-539f3e38ef50 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.675620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1b74c52-1c1d-4aaa-a17d-539f3e38ef50" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.675686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1b74c52-1c1d-4aaa-a17d-539f3e38ef50" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.675839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1b74c52-1c1d-4aaa-a17d-539f3e38ef50" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.675914] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1b74c52-1c1d-4aaa-a17d-539f3e38ef50',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.704880] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.705019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.705078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.705577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.705752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.705954] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.706070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.706137] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.706299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.706378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.706464] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 already deleted. [ 680.706546] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.032950] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.035345] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.035345] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.035345] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.035345] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.035345] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 73a714ef-b157-4072-a032-e9b77adf890a not found, creating... [ 681.035345] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.035345] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.036284] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.036692] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.038649] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.038649] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.038649] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.038649] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.038649] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.038649] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.040628] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 73a714ef-b157-4072-a032-e9b77adf890a is going to be created. [ 681.061246] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.061340] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.063064] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.063064] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.063064] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.063064] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-73a714ef-b157-4072-a032-e9b77adf890a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.180796] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.180796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.180796] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.180796] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1b74c52-1c1d-4aaa-a17d-539f3e38ef50 with status ACTIVE [ 681.180796] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.180796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.180796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.180796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.180796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.180796] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.180796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.180796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.180796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.180796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.181536] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.185112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.185112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.185112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.185112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.185112] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1b74c52-1c1d-4aaa-a17d-539f3e38ef50 is going to be updated. [ 681.206618] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.206922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.206922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.207173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.207287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.207447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1b74c52-1c1d-4aaa-a17d-539f3e38ef50" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.364349] env[68109]: INFO networking_nsxv3.common.synchronization [None req-1480b360-da0c-47b0-a272-70e79e01e8e7 None None] Enqueued Resource ID: 49f95aaf-ea99-4ef4-9250-a55d048bc083 with Priority: HIGHEST for action port [ 681.364349] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f95aaf-ea99-4ef4-9250-a55d048bc083 with Priority: HIGHEST for action port [ 681.365751] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-49f95aaf-ea99-4ef4-9250-a55d048bc083 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.365751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49f95aaf-ea99-4ef4-9250-a55d048bc083" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.365917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49f95aaf-ea99-4ef4-9250-a55d048bc083" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.366409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49f95aaf-ea99-4ef4-9250-a55d048bc083" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.366958] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49f95aaf-ea99-4ef4-9250-a55d048bc083',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.659274] env[68109]: INFO networking_nsxv3.common.synchronization [None req-7cf46c0c-4abc-4d5a-8234-aa25fe0c3bf8 None None] Enqueued Resource ID: ff0508a1-f4ab-4d73-8704-a0310c8dfbd6 with Priority: HIGHEST for action port [ 681.659634] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff0508a1-f4ab-4d73-8704-a0310c8dfbd6 with Priority: HIGHEST for action port [ 681.660238] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff0508a1-f4ab-4d73-8704-a0310c8dfbd6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.660380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff0508a1-f4ab-4d73-8704-a0310c8dfbd6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.660423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff0508a1-f4ab-4d73-8704-a0310c8dfbd6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.661315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff0508a1-f4ab-4d73-8704-a0310c8dfbd6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.661315] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff0508a1-f4ab-4d73-8704-a0310c8dfbd6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.684221] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.801870] env[68109]: INFO networking_nsxv3.common.synchronization [req-9cb2a2c9-ad99-4c97-b3f3-de063f5f1112 req-0535c806-a702-449a-9a39-fbf03dee251e service nova] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_rules [ 681.802061] env[68109]: INFO networking_nsxv3.common.synchronization [req-9cb2a2c9-ad99-4c97-b3f3-de063f5f1112 req-0535c806-a702-449a-9a39-fbf03dee251e service nova] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 681.802234] env[68109]: INFO networking_nsxv3.common.synchronization [req-9cb2a2c9-ad99-4c97-b3f3-de063f5f1112 req-0535c806-a702-449a-9a39-fbf03dee251e service nova] Enqueued Resource ID: 73a714ef-b157-4072-a032-e9b77adf890a with Priority: HIGHEST for action port [ 681.802443] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_rules [ 681.802619] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 681.802724] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73a714ef-b157-4072-a032-e9b77adf890a with Priority: HIGHEST for action port [ 681.803294] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.805242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.805328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.805564] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.805674] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.807130] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.807130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.807130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.807416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.807642] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.807761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.807815] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.808016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.808107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.808196] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.809055] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-73a714ef-b157-4072-a032-e9b77adf890a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.809189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73a714ef-b157-4072-a032-e9b77adf890a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.809233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73a714ef-b157-4072-a032-e9b77adf890a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.809387] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73a714ef-b157-4072-a032-e9b77adf890a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.809459] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73a714ef-b157-4072-a032-e9b77adf890a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.870678] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49f95aaf-ea99-4ef4-9250-a55d048bc083 [ 681.870678] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.870795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.870833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.871053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.871172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.871296] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49f95aaf-ea99-4ef4-9250-a55d048bc083 already deleted. [ 681.871383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49f95aaf-ea99-4ef4-9250-a55d048bc083" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.029834] env[68109]: INFO networking_nsxv3.common.synchronization [None req-c0935fd6-5b32-4b50-be8a-c864afc777d3 None None] Enqueued Resource ID: 0fe148e7-dc6c-4f5b-9615-191dd0585174 with Priority: HIGHEST for action port [ 682.030543] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe148e7-dc6c-4f5b-9615-191dd0585174 with Priority: HIGHEST for action port [ 682.030959] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fe148e7-dc6c-4f5b-9615-191dd0585174 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.031315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fe148e7-dc6c-4f5b-9615-191dd0585174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.031395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fe148e7-dc6c-4f5b-9615-191dd0585174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.031731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fe148e7-dc6c-4f5b-9615-191dd0585174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.031852] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fe148e7-dc6c-4f5b-9615-191dd0585174',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.165258] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff0508a1-f4ab-4d73-8704-a0310c8dfbd6 [ 682.165258] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.165258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.165258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.165258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.165258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.165258] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff0508a1-f4ab-4d73-8704-a0310c8dfbd6 already deleted. [ 682.165258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff0508a1-f4ab-4d73-8704-a0310c8dfbd6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.187164] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.187164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.187340] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.187411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.187504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.187604] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 is going to be updated. [ 682.215235] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.215502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.215502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.215898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.216148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.225625] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 in Status: IN_PROGRESS for 2s [ 682.311403] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.313197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.313510] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.315065] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73a714ef-b157-4072-a032-e9b77adf890a with status ACTIVE [ 682.315146] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.315243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.315334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.315618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.315724] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.315905] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.316018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.318359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.318589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.318731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.319459] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.319459] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.319459] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.319459] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.319459] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.319459] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73a714ef-b157-4072-a032-e9b77adf890a is going to be updated. [ 682.339495] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.339710] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.339710] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.340165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.340329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.340520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73a714ef-b157-4072-a032-e9b77adf890a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.534686] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0fe148e7-dc6c-4f5b-9615-191dd0585174 [ 682.534911] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.535243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.535243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.535355] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.535475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.535592] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0fe148e7-dc6c-4f5b-9615-191dd0585174 already deleted. [ 682.535662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fe148e7-dc6c-4f5b-9615-191dd0585174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.788795] env[68109]: INFO networking_nsxv3.common.synchronization [req-d1778773-b801-4af1-bd62-932ee64f73ce req-2fc31f43-2a9f-4e78-9b77-be33995b9d51 tempest-FloatingIPsAssociationTestJSON-1926415346 tempest-FloatingIPsAssociationTestJSON-1926415346-project-member] Enqueued Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_members [ 682.790607] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_members [ 682.790607] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.790607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.790607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.791941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.791941] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.791941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.791941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.791941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.791941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.792261] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.822211] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.262311] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-3 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.262666] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.262666] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.262956] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.263184] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.263342] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.264803] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.265133] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.265303] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.265515] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.265633] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.265743] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.265857] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.266007] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.266125] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.266261] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.283671] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.283671] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 683.283671] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.283859] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.284120] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-07b0092b-82ef-44a0-b8dc-f65f247ee6d7 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.284280] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-07b0092b-82ef-44a0-b8dc-f65f247ee6d7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.284400] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-07b0092b-82ef-44a0-b8dc-f65f247ee6d7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.285086] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-07b0092b-82ef-44a0-b8dc-f65f247ee6d7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.285086] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07b0092b-82ef-44a0-b8dc-f65f247ee6d7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.297542] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.325807] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.326072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.326159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.326413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.326526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.326658] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be created. [ 683.350856] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.351019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.351089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.351303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.351458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.359506] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: UNINITIALIZED for 2s [ 683.789034] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.789271] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.789434] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.789703] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.789890] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.790050] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 07b0092b-82ef-44a0-b8dc-f65f247ee6d7 not found, creating... [ 683.790334] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.790502] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.790619] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.790858] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.791016] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.791318] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.791478] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.791610] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.791875] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.792034] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.792198] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 07b0092b-82ef-44a0-b8dc-f65f247ee6d7 is going to be created. [ 683.802199] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.812421] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.812421] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.812421] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.812421] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.812421] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.812421] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-07b0092b-82ef-44a0-b8dc-f65f247ee6d7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.234086] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 in Status: SUCCESS [ 684.234236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.234431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.234709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.234838] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.235169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.235169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.235306] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.235306] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.235381] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.235464] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.304624] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.304984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.304984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.305080] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.305707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.305707] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 is going to be updated. [ 684.334587] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.334758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.334911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.335122] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.335302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.344797] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 in Status: IN_PROGRESS for 2s [ 684.739273] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.739273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.739273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.739273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.739740] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.739740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.739740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.739740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.740165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.740165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.740165] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.740165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.740442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.740442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.740669] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.740792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.740852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.741047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.741147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.741240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.741337] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.243682] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0: rpc.has_security_group_logging(os_id): False [ 685.263211] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.263211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.263211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.263211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.263211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.263211] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.263211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.263211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.263211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.263211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.263211] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.263211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.263211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.263211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.263211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.263841] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.263841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.263841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.263841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.263841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.264028] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 is going to be updated. [ 685.322109] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.322429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.322429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.322773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.322949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.335235] env[68109]: INFO networking_nsxv3.common.synchronization [req-d1778773-b801-4af1-bd62-932ee64f73ce req-917c90af-aa49-46b2-af83-6d16761e8218 service nova] Enqueued Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_rules [ 685.335425] env[68109]: INFO networking_nsxv3.common.synchronization [req-d1778773-b801-4af1-bd62-932ee64f73ce req-917c90af-aa49-46b2-af83-6d16761e8218 service nova] Enqueued Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_members [ 685.336426] env[68109]: INFO networking_nsxv3.common.synchronization [req-d1778773-b801-4af1-bd62-932ee64f73ce req-917c90af-aa49-46b2-af83-6d16761e8218 service nova] Enqueued Resource ID: 07b0092b-82ef-44a0-b8dc-f65f247ee6d7 with Priority: HIGHEST for action port [ 685.336716] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_rules [ 685.336934] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_members [ 685.336979] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b0092b-82ef-44a0-b8dc-f65f247ee6d7 with Priority: HIGHEST for action port [ 685.338508] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 in Status: IN_PROGRESS for 2s [ 685.338780] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.338904] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.338972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.339193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.339276] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.340511] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.340646] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.340853] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-07b0092b-82ef-44a0-b8dc-f65f247ee6d7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.340962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07b0092b-82ef-44a0-b8dc-f65f247ee6d7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.341158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07b0092b-82ef-44a0-b8dc-f65f247ee6d7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.341287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07b0092b-82ef-44a0-b8dc-f65f247ee6d7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.341982] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07b0092b-82ef-44a0-b8dc-f65f247ee6d7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.368280] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 685.368545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.368724] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.368960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.369186] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.369307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.369378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.369553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.369632] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.369719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.369811] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.846558] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.846759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.846964] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07b0092b-82ef-44a0-b8dc-f65f247ee6d7 with status ACTIVE [ 685.847159] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.847288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.847407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.847988] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.847988] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.847988] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.848252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.848252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.848353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.848437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.848614] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.848708] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.848767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.848940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.849038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.849169] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07b0092b-82ef-44a0-b8dc-f65f247ee6d7 is going to be updated. [ 685.870023] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.870196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.870241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.870779] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.870779] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.870779] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07b0092b-82ef-44a0-b8dc-f65f247ee6d7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.874916] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.377187] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 841d58e8-0316-41e3-a855-66ac66e6d9f4: rpc.has_security_group_logging(os_id): False [ 686.397946] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 in Status: SUCCESS [ 686.398541] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.398541] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.398665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.398824] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.398904] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.398949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.399119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.399202] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.399303] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.404809] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.405308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.405308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.405308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.405308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.405618] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.405618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.405732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.405819] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.405885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.406224] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be created. [ 686.463729] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.463941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.464060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.464302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.464526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.474785] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: IN_PROGRESS for 2s [ 686.572369] env[68109]: INFO networking_nsxv3.common.synchronization [req-16b7a842-1b0d-4aa5-b7da-4ad7b5947b05 req-2a9db5c0-a7ea-4aef-b288-a3178553b06d tempest-ImagesOneServerTestJSON-164379074 tempest-ImagesOneServerTestJSON-164379074-project-member] Enqueued Resource ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac with Priority: HIGHEST for action security_group_members [ 686.572961] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac with Priority: HIGHEST for action security_group_members [ 686.573217] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.573341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.573407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.573657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.573818] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.574679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.574679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.574679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.574679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.574679] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.910332] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.078525] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.078692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.078753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.078968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.079076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.079278] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.079375] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.079432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.079588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.079664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.079757] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac is going to be updated. [ 687.107333] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.107471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.107527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.107731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.109433] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.121300] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac in Status: IN_PROGRESS for 2s [ 687.282876] env[68109]: INFO networking_nsxv3.common.synchronization [req-da4d1ed8-fd87-426f-ad4c-c2979744d225 req-6f73309a-f279-42a7-9c1d-9cc5e0c18b85 tempest-MigrationsAdminTest-481783089 tempest-MigrationsAdminTest-481783089-project-member] Enqueued Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_members [ 687.282876] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_members [ 687.286490] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.286490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.286490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.286490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.286490] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.286490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.286490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.286490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.286490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.286490] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.309103] env[68109]: INFO networking_nsxv3.common.synchronization [None req-cca9f06c-4935-4956-9dcf-e09f519554e3 None None] Enqueued Resource ID: 68c73842-e218-43cc-a22e-4a9343906c67 with Priority: HIGHEST for action port [ 687.309579] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c73842-e218-43cc-a22e-4a9343906c67 with Priority: HIGHEST for action port [ 687.310314] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-68c73842-e218-43cc-a22e-4a9343906c67 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.310440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68c73842-e218-43cc-a22e-4a9343906c67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.310576] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68c73842-e218-43cc-a22e-4a9343906c67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.310769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68c73842-e218-43cc-a22e-4a9343906c67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.310855] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68c73842-e218-43cc-a22e-4a9343906c67',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.351555] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 in Status: SUCCESS [ 687.351769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.413618] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.687097] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.687097] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.687261] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.689535] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.689535] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.689535] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.689535] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.689966] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.690217] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.690354] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.690472] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.690587] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.690685] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.690796] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.693029] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.693029] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.709677] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.711033] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 687.711033] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.711033] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.711033] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-0eae6274-e922-4433-8afc-d48c9ace5943 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.711033] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-0eae6274-e922-4433-8afc-d48c9ace5943" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.711033] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-0eae6274-e922-4433-8afc-d48c9ace5943" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.711565] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-0eae6274-e922-4433-8afc-d48c9ace5943" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.711565] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eae6274-e922-4433-8afc-d48c9ace5943',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.788468] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.788638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.788703] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.788926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.789160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.789238] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.789856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.789856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.789856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.789856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.789856] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a already deleted. [ 687.789856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.815302] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68c73842-e218-43cc-a22e-4a9343906c67 [ 687.815302] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.815302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.815302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.815302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.815302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.815302] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68c73842-e218-43cc-a22e-4a9343906c67 already deleted. [ 687.815302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68c73842-e218-43cc-a22e-4a9343906c67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.916337] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.916494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.916649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.916787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.916928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.917012] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 is going to be updated. [ 687.945177] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.945324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.945396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.945615] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.945761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.957914] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 in Status: IN_PROGRESS for 2s [ 688.215685] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.215928] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.216072] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.216689] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.216689] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.216689] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 0eae6274-e922-4433-8afc-d48c9ace5943 not found, creating... [ 688.217709] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.217709] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.217709] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.217709] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.217709] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.218018] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.218076] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.218585] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.218585] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.218585] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.218725] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 0eae6274-e922-4433-8afc-d48c9ace5943 is going to be created. [ 688.243797] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.248035] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.248035] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.248035] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.248035] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.248035] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-0eae6274-e922-4433-8afc-d48c9ace5943" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.488635] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 688.488962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.130640] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac in Status: SUCCESS [ 689.131262] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac deletion is rescheduled due to dependency. [ 689.131262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.495708] env[68109]: INFO networking_nsxv3.common.synchronization [req-da4d1ed8-fd87-426f-ad4c-c2979744d225 req-14b30da8-f409-42ed-a6be-51e3c5e1ca09 service nova] Enqueued Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_rules [ 689.496062] env[68109]: INFO networking_nsxv3.common.synchronization [req-da4d1ed8-fd87-426f-ad4c-c2979744d225 req-14b30da8-f409-42ed-a6be-51e3c5e1ca09 service nova] Enqueued Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_members [ 689.496062] env[68109]: INFO networking_nsxv3.common.synchronization [req-da4d1ed8-fd87-426f-ad4c-c2979744d225 req-14b30da8-f409-42ed-a6be-51e3c5e1ca09 service nova] Enqueued Resource ID: 0eae6274-e922-4433-8afc-d48c9ace5943 with Priority: HIGHEST for action port [ 689.496146] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_rules [ 689.497039] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_members [ 689.497039] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eae6274-e922-4433-8afc-d48c9ace5943 with Priority: HIGHEST for action port [ 689.497039] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.497039] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.498478] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.498478] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.498478] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.499119] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.499255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.499302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.499856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.499856] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.499856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.499856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.499856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.500092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.500092] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.500875] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eae6274-e922-4433-8afc-d48c9ace5943 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.500976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eae6274-e922-4433-8afc-d48c9ace5943" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.501753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eae6274-e922-4433-8afc-d48c9ace5943" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.501919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eae6274-e922-4433-8afc-d48c9ace5943" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.502038] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eae6274-e922-4433-8afc-d48c9ace5943',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.826786] env[68109]: INFO networking_nsxv3.common.synchronization [None req-7c9dab2e-aadd-4789-85fe-dbf4345c080d None None] Enqueued Resource ID: 432d102f-b4f5-4eb2-b097-c946916538e3 with Priority: HIGHEST for action port [ 689.827579] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 432d102f-b4f5-4eb2-b097-c946916538e3 with Priority: HIGHEST for action port [ 689.827579] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-432d102f-b4f5-4eb2-b097-c946916538e3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.827727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-432d102f-b4f5-4eb2-b097-c946916538e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.827763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-432d102f-b4f5-4eb2-b097-c946916538e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.827985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-432d102f-b4f5-4eb2-b097-c946916538e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.828331] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('432d102f-b4f5-4eb2-b097-c946916538e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.966484] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 in Status: SUCCESS [ 689.966787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.966907] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.967090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.970017] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.970017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.970017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.970017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.970017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.970017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.970017] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.006413] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0eae6274-e922-4433-8afc-d48c9ace5943 with status ACTIVE [ 690.006857] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.007334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.007449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.007672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.007770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.008665] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.008665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.008665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.008665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.008665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.008665] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.009419] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.009419] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.009419] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.009419] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.009597] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0eae6274-e922-4433-8afc-d48c9ace5943 is going to be updated. [ 690.011090] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.011227] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.011431] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.031596] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.031596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.031596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.031596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.031596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.031596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eae6274-e922-4433-8afc-d48c9ace5943" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.331901] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 432d102f-b4f5-4eb2-b097-c946916538e3 [ 690.331901] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.331901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.331901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.331901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.331901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.331901] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:432d102f-b4f5-4eb2-b097-c946916538e3 already deleted. [ 690.331901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-432d102f-b4f5-4eb2-b097-c946916538e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.469959] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.470132] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.470200] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.470417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.470618] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.470749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.470822] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.470930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.471043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.471111] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.471254] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.471343] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.471402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.471545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.471670] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.471755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.471813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.471954] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.472037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.472125] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.472219] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.514205] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.976895] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa5eec70-e6f3-4480-95eb-d20df1020e05: rpc.has_security_group_logging(os_id): False [ 690.995206] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.995206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.995206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.995206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.995206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.995206] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.995206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.995206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.995206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.995790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.995790] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.995790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.995790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.995790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.996100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.996100] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.996382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.996382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.996382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.996530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.996530] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 is going to be updated. [ 691.016848] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.016848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.016848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.017178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.017222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.017588] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a is going to be created. [ 691.036607] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.036991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.036991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.037107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.037707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.046436] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a in Status: UNINITIALIZED for 2s [ 691.053503] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.053796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.053886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.054096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.054226] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.068469] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 in Status: IN_PROGRESS for 2s [ 691.842813] env[68109]: INFO networking_nsxv3.common.synchronization [None req-3a8736db-d056-4684-b321-469da949bb82 None None] Enqueued Resource ID: 996d19b3-3b40-490b-9ffb-93f4c45b9225 with Priority: HIGHEST for action port [ 691.843994] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 996d19b3-3b40-490b-9ffb-93f4c45b9225 with Priority: HIGHEST for action port [ 691.845407] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-996d19b3-3b40-490b-9ffb-93f4c45b9225 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.845594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-996d19b3-3b40-490b-9ffb-93f4c45b9225" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.847459] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-996d19b3-3b40-490b-9ffb-93f4c45b9225" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.847459] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-996d19b3-3b40-490b-9ffb-93f4c45b9225" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.847459] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('996d19b3-3b40-490b-9ffb-93f4c45b9225',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.877736] env[68109]: INFO networking_nsxv3.common.synchronization [req-04a41b11-d383-4b49-a154-fc48c8a477e8 req-6c6c0293-5286-497c-beed-d206a90c3518 tempest-ServerRescueNegativeTestJSON-575486598 tempest-ServerRescueNegativeTestJSON-575486598-project-member] Enqueued Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_members [ 691.881329] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_members [ 691.882745] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.882975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.882975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.883300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.883463] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.883769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.883769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.883890] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.884026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.884097] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.352507] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 996d19b3-3b40-490b-9ffb-93f4c45b9225 [ 692.352507] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.352507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.352507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.352507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.352507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.352507] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:996d19b3-3b40-490b-9ffb-93f4c45b9225 already deleted. [ 692.352507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-996d19b3-3b40-490b-9ffb-93f4c45b9225" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.391373] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.391373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.391373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.391373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.391373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.391373] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.391373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.391373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.391373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.391373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.391373] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 already deleted. [ 692.391373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.055751] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a in Status: SUCCESS [ 693.056341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.056694] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.057024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.059101] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.059101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.059101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.059101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.059101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.059101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.059101] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.081117] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 in Status: SUCCESS [ 693.081117] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.379766] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-9 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.379766] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.379766] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.380861] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.380861] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.380861] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.380861] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.380861] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.381667] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.382165] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.382514] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.382722] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.382873] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.383025] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.383165] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.383792] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.401965] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.402158] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 693.402303] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.402486] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.402843] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-fba29ee6-b1f0-4b66-af38-386db6c7b526 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.403047] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-fba29ee6-b1f0-4b66-af38-386db6c7b526" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.403173] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-fba29ee6-b1f0-4b66-af38-386db6c7b526" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.403489] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-fba29ee6-b1f0-4b66-af38-386db6c7b526" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.403635] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fba29ee6-b1f0-4b66-af38-386db6c7b526',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.429937] env[68109]: INFO networking_nsxv3.common.synchronization [None req-30ef4437-8cdd-4b6a-a5f9-5b4098f0198c None None] Enqueued Resource ID: 332a6ad9-01cc-4ead-a213-4b72e7ee3112 with Priority: HIGHEST for action port [ 693.430648] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 332a6ad9-01cc-4ead-a213-4b72e7ee3112 with Priority: HIGHEST for action port [ 693.431363] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-332a6ad9-01cc-4ead-a213-4b72e7ee3112 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.432102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-332a6ad9-01cc-4ead-a213-4b72e7ee3112" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.432294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-332a6ad9-01cc-4ead-a213-4b72e7ee3112" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.432698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-332a6ad9-01cc-4ead-a213-4b72e7ee3112" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.432698] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('332a6ad9-01cc-4ead-a213-4b72e7ee3112',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.562555] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.562716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.562716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.562920] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.563392] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.563392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.563392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.563392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.563664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.563664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.563731] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.563833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.563874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.564018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.564164] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.564327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.564327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.564458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.564532] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.564614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.564707] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.694362] env[68109]: INFO networking_nsxv3.common.synchronization [req-384ffa65-6c5f-4cf0-bcb1-9d366c755e26 req-f43e83c9-6f90-4343-86a3-32c81fe4b0c3 tempest-DeleteServersAdminTestJSON-886050253 tempest-DeleteServersAdminTestJSON-886050253-project-member] Enqueued Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_members [ 693.699579] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 with Priority: HIGHEST for action security_group_members [ 693.701181] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.701347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.701440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.702208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.702407] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.702840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.702840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.703441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.703817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.704798] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bc3e4c-0cd7-46a0-8516-a78e344aa1a0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.911933] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.911933] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.911933] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.911933] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.911933] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.911933] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port fba29ee6-b1f0-4b66-af38-386db6c7b526 not found, creating... [ 693.912778] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.912994] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.913160] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.913388] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.913655] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.913867] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.914051] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.914167] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.914386] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.914524] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.914669] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: fba29ee6-b1f0-4b66-af38-386db6c7b526 is going to be created. [ 693.933954] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.934317] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.934396] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.934682] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.934975] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.935246] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-fba29ee6-b1f0-4b66-af38-386db6c7b526" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.936910] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 332a6ad9-01cc-4ead-a213-4b72e7ee3112 [ 693.937121] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.937263] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.937303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.937466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.937661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.937661] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:332a6ad9-01cc-4ead-a213-4b72e7ee3112 already deleted. [ 693.937949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-332a6ad9-01cc-4ead-a213-4b72e7ee3112" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.068519] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f5de880-5f98-48cf-ba2c-fdf857770d6a: rpc.has_security_group_logging(os_id): False [ 694.093024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.093024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.093024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.093024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.093024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.093024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.093024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.093024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.093024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.093024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.093024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.093024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.093024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.093024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.093024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.093732] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.093732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.093732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.093732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.093732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.093732] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a is going to be created. [ 694.158804] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.158973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.159074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.159423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.159676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.171146] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a in Status: IN_PROGRESS for 2s [ 694.208547] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.208711] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.208787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.209012] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.209131] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.209373] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.209947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.209947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.209947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.209947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.209947] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 is going to be updated. [ 694.249231] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.249231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.249231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.249467] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.249467] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.261883] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 in Status: IN_PROGRESS for 2s [ 694.352989] env[68109]: INFO networking_nsxv3.common.synchronization [None req-4668b2a6-b961-4b55-8b83-e359e2fe349f tempest-ServerActionsV293TestJSON-1191773725 tempest-ServerActionsV293TestJSON-1191773725-project-member] Enqueued Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGHEST for action security_group_rules [ 694.352989] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGHEST for action security_group_rules [ 694.352989] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1589ee36-8ec7-4a35-a6c9-857230faca44 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.352989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.357558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.357558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.357558] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1589ee36-8ec7-4a35-a6c9-857230faca44',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.450845] env[68109]: INFO networking_nsxv3.common.synchronization [None req-eb5a02fe-1f23-4107-beae-05439c01c1ec tempest-ServerActionsV293TestJSON-1191773725 tempest-ServerActionsV293TestJSON-1191773725-project-member] Enqueued Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGHEST for action security_group_rules [ 694.450845] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGHEST for action security_group_rules [ 694.452665] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1589ee36-8ec7-4a35-a6c9-857230faca44 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.452665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.472782] env[68109]: INFO networking_nsxv3.common.synchronization [None req-44bcc185-030c-4bf7-9434-f6f9b54c4d99 None None] Enqueued Resource ID: 96c3788f-d591-4e90-af4e-dbe38829733b with Priority: HIGHEST for action port [ 694.473060] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c3788f-d591-4e90-af4e-dbe38829733b with Priority: HIGHEST for action port [ 694.473636] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-96c3788f-d591-4e90-af4e-dbe38829733b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.473738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96c3788f-d591-4e90-af4e-dbe38829733b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.473853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96c3788f-d591-4e90-af4e-dbe38829733b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.478032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96c3788f-d591-4e90-af4e-dbe38829733b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.478032] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96c3788f-d591-4e90-af4e-dbe38829733b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.880274] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.880567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.880567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.880766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.880822] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.880896] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 already deleted. [ 694.880988] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.883033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.883033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.883033] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1589ee36-8ec7-4a35-a6c9-857230faca44',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.963153] env[68109]: INFO networking_nsxv3.common.synchronization [req-04a41b11-d383-4b49-a154-fc48c8a477e8 req-36a8fae2-ab92-474d-95b3-6c851116ea9d service nova] Enqueued Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_rules [ 694.963153] env[68109]: INFO networking_nsxv3.common.synchronization [req-04a41b11-d383-4b49-a154-fc48c8a477e8 req-36a8fae2-ab92-474d-95b3-6c851116ea9d service nova] Enqueued Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_members [ 694.963153] env[68109]: INFO networking_nsxv3.common.synchronization [req-04a41b11-d383-4b49-a154-fc48c8a477e8 req-36a8fae2-ab92-474d-95b3-6c851116ea9d service nova] Enqueued Resource ID: fba29ee6-b1f0-4b66-af38-386db6c7b526 with Priority: HIGHEST for action port [ 694.963153] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_rules [ 694.963153] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_members [ 694.963153] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba29ee6-b1f0-4b66-af38-386db6c7b526 with Priority: HIGHEST for action port [ 694.965768] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.966079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.966220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.966560] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.966790] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.969713] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.970149] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.970300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.970545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.973913] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.973913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.973913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.973913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.973913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.973913] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.973913] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-fba29ee6-b1f0-4b66-af38-386db6c7b526 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.973913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fba29ee6-b1f0-4b66-af38-386db6c7b526" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.973913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fba29ee6-b1f0-4b66-af38-386db6c7b526" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.973913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fba29ee6-b1f0-4b66-af38-386db6c7b526" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.973913] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fba29ee6-b1f0-4b66-af38-386db6c7b526',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.981112] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96c3788f-d591-4e90-af4e-dbe38829733b [ 694.981112] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.981112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.981112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.981112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.981112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.981112] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96c3788f-d591-4e90-af4e-dbe38829733b already deleted. [ 694.981112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96c3788f-d591-4e90-af4e-dbe38829733b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.403210] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.403582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.403582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.403665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.403753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.403818] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 already deleted. [ 695.403889] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.474340] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.474510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.474846] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.475976] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fba29ee6-b1f0-4b66-af38-386db6c7b526 with status ACTIVE [ 695.476049] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.476170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.476288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.476509] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.476558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.476730] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.476819] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.476878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.477032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.477109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.477285] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.477397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.477428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.477564] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.477636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.477764] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fba29ee6-b1f0-4b66-af38-386db6c7b526 is going to be updated. [ 695.499039] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.499196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.499269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.499525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.500744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.500744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fba29ee6-b1f0-4b66-af38-386db6c7b526" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.552255] env[68109]: INFO networking_nsxv3.common.synchronization [req-48cdf2d8-8d14-4fbc-84aa-bbc1fa47c80e req-bea65cdf-295e-4566-a89f-0fc299836428 tempest-ServersTestFqdnHostnames-402908171 tempest-ServersTestFqdnHostnames-402908171-project-member] Enqueued Resource ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc with Priority: HIGHEST for action security_group_members [ 695.552255] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc with Priority: HIGHEST for action security_group_members [ 695.552255] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.552255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.552655] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.552981] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.553278] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.553483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.553608] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.553844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.554047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.554388] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be0b8028-d9fc-4359-aba8-9adf2a89c6bc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.980026] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.058018] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.058289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.058460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.058696] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.058832] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.059277] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.059417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.059486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.059746] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.059975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.060142] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc already deleted. [ 696.060298] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.182313] env[68109]: INFO networking_nsxv3.common.synchronization [None req-a93edcfa-54c7-46f7-82bb-6f78fbb504b9 None None] Enqueued Resource ID: 5166b8b2-f5f2-4cf3-9971-708ceab35b39 with Priority: HIGHEST for action port [ 696.183590] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a in Status: SUCCESS [ 696.183912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.184153] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5166b8b2-f5f2-4cf3-9971-708ceab35b39 with Priority: HIGHEST for action port [ 696.184867] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-5166b8b2-f5f2-4cf3-9971-708ceab35b39 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.185254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5166b8b2-f5f2-4cf3-9971-708ceab35b39" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.185379] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5166b8b2-f5f2-4cf3-9971-708ceab35b39" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.185774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5166b8b2-f5f2-4cf3-9971-708ceab35b39" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.185910] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5166b8b2-f5f2-4cf3-9971-708ceab35b39',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.271846] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 in Status: SUCCESS [ 696.272044] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bc3e4c-0cd7-46a0-8516-a78e344aa1a0 deletion is rescheduled due to dependency. [ 696.272170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bc3e4c-0cd7-46a0-8516-a78e344aa1a0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.484933] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.485229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.485229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.485405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.485495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.485786] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 is going to be created. [ 696.512357] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.512502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.512571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.512853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.513030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.522358] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: UNINITIALIZED for 2s [ 696.575233] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.575556] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-41" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.577568] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-41" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.577986] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-41" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.578365] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.578525] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.578687] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.578990] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.579339] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.579630] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.579771] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.579904] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.580052] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.580230] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 696.580403] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.580552] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.600887] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.600887] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 696.600887] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.600887] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-41" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.600887] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-2a17844a-923a-4b9b-9de0-3a9b6b2dd974 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.601219] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-2a17844a-923a-4b9b-9de0-3a9b6b2dd974" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.601219] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-2a17844a-923a-4b9b-9de0-3a9b6b2dd974" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.601562] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-2a17844a-923a-4b9b-9de0-3a9b6b2dd974" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.601634] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a17844a-923a-4b9b-9de0-3a9b6b2dd974',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.687610] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5166b8b2-f5f2-4cf3-9971-708ceab35b39 [ 696.687876] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.687965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.688077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.688330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.688421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.688520] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5166b8b2-f5f2-4cf3-9971-708ceab35b39 already deleted. [ 696.688602] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5166b8b2-f5f2-4cf3-9971-708ceab35b39" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.104372] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.104610] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.104737] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.105072] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.105199] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.105384] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 2a17844a-923a-4b9b-9de0-3a9b6b2dd974 not found, creating... [ 697.109027] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.109027] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.109027] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.109027] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.109027] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.109027] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.109027] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.109027] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.109027] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.109027] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.109445] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 2a17844a-923a-4b9b-9de0-3a9b6b2dd974 is going to be created. [ 697.128179] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.128371] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.129028] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.129028] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.129245] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.129473] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-2a17844a-923a-4b9b-9de0-3a9b6b2dd974" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.366661] env[68109]: INFO networking_nsxv3.common.synchronization [req-48cdf2d8-8d14-4fbc-84aa-bbc1fa47c80e req-e5f47985-edf9-49ac-ac5a-434b38b5f3d5 service nova] Enqueued Resource ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc with Priority: HIGHEST for action security_group_rules [ 698.367023] env[68109]: INFO networking_nsxv3.common.synchronization [req-48cdf2d8-8d14-4fbc-84aa-bbc1fa47c80e req-e5f47985-edf9-49ac-ac5a-434b38b5f3d5 service nova] Enqueued Resource ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc with Priority: HIGHEST for action security_group_members [ 698.367081] env[68109]: INFO networking_nsxv3.common.synchronization [req-48cdf2d8-8d14-4fbc-84aa-bbc1fa47c80e req-e5f47985-edf9-49ac-ac5a-434b38b5f3d5 service nova] Enqueued Resource ID: 2a17844a-923a-4b9b-9de0-3a9b6b2dd974 with Priority: HIGHEST for action port [ 698.367309] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc with Priority: HIGHEST for action security_group_rules [ 698.367437] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc with Priority: HIGHEST for action security_group_members [ 698.367536] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a17844a-923a-4b9b-9de0-3a9b6b2dd974 with Priority: HIGHEST for action port [ 698.368557] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.368695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.368767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.368970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.369063] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be0b8028-d9fc-4359-aba8-9adf2a89c6bc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.369881] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.369991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.370069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.370250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.370402] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.370519] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.370561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.370687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.370770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.370857] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be0b8028-d9fc-4359-aba8-9adf2a89c6bc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.371613] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a17844a-923a-4b9b-9de0-3a9b6b2dd974 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.371742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a17844a-923a-4b9b-9de0-3a9b6b2dd974" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.371811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a17844a-923a-4b9b-9de0-3a9b6b2dd974" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.371999] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a17844a-923a-4b9b-9de0-3a9b6b2dd974" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.372090] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a17844a-923a-4b9b-9de0-3a9b6b2dd974',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.432702] env[68109]: INFO networking_nsxv3.common.synchronization [req-69585159-0edd-430a-b88a-128acc58580c req-3fcd26f7-531d-432c-b115-98e227297044 tempest-DeleteServersTestJSON-2063667557 tempest-DeleteServersTestJSON-2063667557-project-member] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 698.433283] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 698.433593] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.433766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.433839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.434025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.434181] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.434282] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.434347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.434495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.434581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.434674] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.532904] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: SUCCESS [ 698.533138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.533300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.533523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.533771] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.533976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.533976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.534201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.534326] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.534541] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.534646] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.874603] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be0b8028-d9fc-4359-aba8-9adf2a89c6bc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.876581] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.876739] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.876937] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a17844a-923a-4b9b-9de0-3a9b6b2dd974 with status ACTIVE [ 698.877172] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.877319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.877413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.877645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.877774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.877973] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.878148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.878269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.882730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.882730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.882730] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.882730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.882730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.882730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.882730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.882730] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a17844a-923a-4b9b-9de0-3a9b6b2dd974 is going to be updated. [ 698.901071] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.901325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.901424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.901665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.901838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.902051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a17844a-923a-4b9b-9de0-3a9b6b2dd974" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.937190] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.937414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.937507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.937796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.937965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.938168] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.938283] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.938373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.938565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.938664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.938757] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 698.961476] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.961663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.961741] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.962097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.962267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.971807] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 699.037289] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.037751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.037881] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.038214] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.038454] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.038711] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.038711] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.038973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.039121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.039276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.039502] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.039659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.039766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.039982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.041812] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.042073] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.042244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.042725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.042989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.043146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.043280] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.278124] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-505 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.278124] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.278124] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.278632] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.278632] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.280259] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.280259] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.280259] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.280259] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.280259] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.280259] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.280259] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.280259] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.280259] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.280259] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.281085] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.298934] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.299140] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 699.299283] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.303030] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.303030] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-d6e1daba-9277-40ee-b9e6-b2409fa37e20 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.303030] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-d6e1daba-9277-40ee-b9e6-b2409fa37e20" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.303030] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-d6e1daba-9277-40ee-b9e6-b2409fa37e20" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.303030] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-d6e1daba-9277-40ee-b9e6-b2409fa37e20" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.303030] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6e1daba-9277-40ee-b9e6-b2409fa37e20',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.383624] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be0b8028-d9fc-4359-aba8-9adf2a89c6bc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.546479] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7188635c-e1c3-4fba-9e1d-f639d22a02e3: rpc.has_security_group_logging(os_id): False [ 699.563495] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.563660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.563713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.563961] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.564069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.564261] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.564362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.564427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.564580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.564658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.568020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.568020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.568020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.568020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.568020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.568020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.568020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.568020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.568020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.568020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.568020] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 is going to be created. [ 699.615566] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.615763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.615763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.615986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.616181] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.625738] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: IN_PROGRESS for 2s [ 699.805186] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.805411] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.805538] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.805828] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.805981] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.806841] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port d6e1daba-9277-40ee-b9e6-b2409fa37e20 not found, creating... [ 699.808662] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.808662] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.808662] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.808662] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.808662] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.808662] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.808662] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.809074] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.809183] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.809329] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.809512] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: d6e1daba-9277-40ee-b9e6-b2409fa37e20 is going to be created. [ 699.831193] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.831587] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.831814] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.832184] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.832425] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.832711] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-d6e1daba-9277-40ee-b9e6-b2409fa37e20" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.886650] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.886891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.886964] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.887391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.887391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.887646] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc is going to be created. [ 699.930494] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.930494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.930494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.930494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.930494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.940646] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc in Status: UNINITIALIZED for 2s [ 700.984712] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 700.984712] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 deletion is rescheduled due to dependency. [ 700.984712] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.063107] env[68109]: INFO networking_nsxv3.common.synchronization [req-69585159-0edd-430a-b88a-128acc58580c req-620be8e6-72c5-4a17-8c01-ca88aecc587d service nova] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_rules [ 701.063107] env[68109]: INFO networking_nsxv3.common.synchronization [req-69585159-0edd-430a-b88a-128acc58580c req-620be8e6-72c5-4a17-8c01-ca88aecc587d service nova] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 701.063107] env[68109]: INFO networking_nsxv3.common.synchronization [req-69585159-0edd-430a-b88a-128acc58580c req-620be8e6-72c5-4a17-8c01-ca88aecc587d service nova] Enqueued Resource ID: d6e1daba-9277-40ee-b9e6-b2409fa37e20 with Priority: HIGHEST for action port [ 701.063107] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_rules [ 701.063107] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 701.063107] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e1daba-9277-40ee-b9e6-b2409fa37e20 with Priority: HIGHEST for action port [ 701.063107] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.063107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.063107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.063107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.063107] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.063107] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.063107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.063107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.063107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.063107] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.063107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.063107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.064037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.064037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.064037] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.064537] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6e1daba-9277-40ee-b9e6-b2409fa37e20 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.068184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6e1daba-9277-40ee-b9e6-b2409fa37e20" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.068281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6e1daba-9277-40ee-b9e6-b2409fa37e20" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.068472] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6e1daba-9277-40ee-b9e6-b2409fa37e20" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.068588] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6e1daba-9277-40ee-b9e6-b2409fa37e20',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.570566] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.572319] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.572439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.572631] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6e1daba-9277-40ee-b9e6-b2409fa37e20 with status ACTIVE [ 701.572828] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.572940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.573012] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.573412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.573485] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.573671] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.573770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.575875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.575875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.575875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.575875] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.575875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.575875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.575875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.575875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.575875] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6e1daba-9277-40ee-b9e6-b2409fa37e20 is going to be updated. [ 701.601667] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.601817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.601872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.602116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.602261] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.602427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6e1daba-9277-40ee-b9e6-b2409fa37e20" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.637293] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: SUCCESS [ 701.637523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.950910] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc in Status: SUCCESS [ 701.950910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.950910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.950910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.950910] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.951486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.951604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.951789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.951881] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.951975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.952119] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be0b8028-d9fc-4359-aba8-9adf2a89c6bc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.077317] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.459256] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be0b8028-d9fc-4359-aba8-9adf2a89c6bc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.581079] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.581250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.581317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.581783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.581783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.581783] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 702.610867] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.612079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.612079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.612079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.612079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.620164] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 702.961070] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be0b8028-d9fc-4359-aba8-9adf2a89c6bc: rpc.has_security_group_logging(os_id): False [ 702.977480] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.977645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.977699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.977890] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.977984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.978241] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.978412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.978482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.978664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.978750] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.978954] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc is going to be created. [ 703.035445] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.035445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.035445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.039392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.039610] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.054116] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc in Status: IN_PROGRESS for 2s [ 704.368063] env[68109]: INFO networking_nsxv3.common.synchronization [req-ab23a6e3-9d10-4d4a-95cb-b2190827d8fb req-71430aec-f54f-410f-bb6a-571404cfcd6e tempest-ServerRescueNegativeTestJSON-575486598 tempest-ServerRescueNegativeTestJSON-575486598-project-member] Enqueued Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_members [ 704.368063] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_members [ 704.368063] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.368063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.368063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.368063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.368063] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.368063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.368063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.368063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.368063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.368063] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.629628] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 704.629849] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.630401] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.630624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.630823] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.630937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.631009] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.631173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.631619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.631619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.631619] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.758301] env[68109]: INFO networking_nsxv3.common.synchronization [None req-2eeeaf74-99d6-47e4-9c67-25c964d3de75 None None] Enqueued Resource ID: 8937d05c-1b2d-4362-afdd-39bd405890c5 with Priority: HIGHEST for action port [ 704.758569] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8937d05c-1b2d-4362-afdd-39bd405890c5 with Priority: HIGHEST for action port [ 704.759895] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-8937d05c-1b2d-4362-afdd-39bd405890c5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.760072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8937d05c-1b2d-4362-afdd-39bd405890c5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.760566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8937d05c-1b2d-4362-afdd-39bd405890c5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.760933] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8937d05c-1b2d-4362-afdd-39bd405890c5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.761023] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8937d05c-1b2d-4362-afdd-39bd405890c5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.872169] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.956139] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-9 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.956139] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.956247] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.956513] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.957249] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.957249] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.957249] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.957534] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.957733] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.958031] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.958615] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.958615] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.958615] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.958615] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.958754] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.958893] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.980404] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.980404] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 704.980404] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.980404] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.980404] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-226b4b5c-279d-413f-827c-2de29e2183d1 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.980404] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-226b4b5c-279d-413f-827c-2de29e2183d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.980404] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-226b4b5c-279d-413f-827c-2de29e2183d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.980823] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-226b4b5c-279d-413f-827c-2de29e2183d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.980974] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('226b4b5c-279d-413f-827c-2de29e2183d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.068518] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc in Status: SUCCESS [ 705.071051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.137060] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.140289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.140289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.140289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.140289] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.140289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.140289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.140289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.140289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.140289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.140289] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.140289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.140289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.140289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.140289] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.141329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.141570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.141913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.142200] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.142499] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.142769] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.263316] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8937d05c-1b2d-4362-afdd-39bd405890c5 [ 705.263605] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.263787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.263892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.264475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.264475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.264475] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8937d05c-1b2d-4362-afdd-39bd405890c5 already deleted. [ 705.264642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8937d05c-1b2d-4362-afdd-39bd405890c5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.375527] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.483675] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.484018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.484172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.484463] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.484612] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.484770] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 226b4b5c-279d-413f-827c-2de29e2183d1 not found, creating... [ 705.485058] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.485218] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.485336] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.485557] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.485699] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.485993] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.486277] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.486415] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.486636] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.486867] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.487043] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 226b4b5c-279d-413f-827c-2de29e2183d1 is going to be created. [ 705.511324] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.511987] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.511987] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.511987] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.512665] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.513087] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-226b4b5c-279d-413f-827c-2de29e2183d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.646029] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3775fbff-3109-41e9-a7b4-71b12133d9f0: rpc.has_security_group_logging(os_id): False [ 705.667352] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.667534] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.667776] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.667923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.668096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.668426] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.668548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.668674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.668928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.670698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.670971] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.671170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.671347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.671660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.671791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.672243] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.672450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.672565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.672867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.672992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.673199] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 705.736449] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.736746] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.736900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.737226] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.737483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.749965] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 705.751931] env[68109]: INFO networking_nsxv3.common.synchronization [req-fdd1ef1e-2855-4976-b408-021fe57c2603 req-61be5da9-ea67-4b5f-8ee5-84afd6654c91 tempest-FloatingIPsAssociationTestJSON-1926415346 tempest-FloatingIPsAssociationTestJSON-1926415346-project-member] Enqueued Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_members [ 705.753718] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_members [ 705.754152] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.754319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.754410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.754657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.754853] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.754995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.755137] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.755393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.755501] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.755645] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.879633] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.879633] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.879633] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.879813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.879813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.879965] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 is going to be updated. [ 705.916025] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.916025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.916025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.916025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.916025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.924675] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: IN_PROGRESS for 2s [ 706.258435] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.670201] env[68109]: INFO networking_nsxv3.common.synchronization [req-ab23a6e3-9d10-4d4a-95cb-b2190827d8fb req-ee4dfcd0-1a56-44ff-8bad-088fd6a217a6 service nova] Enqueued Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_rules [ 706.670453] env[68109]: INFO networking_nsxv3.common.synchronization [req-ab23a6e3-9d10-4d4a-95cb-b2190827d8fb req-ee4dfcd0-1a56-44ff-8bad-088fd6a217a6 service nova] Enqueued Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_members [ 706.670576] env[68109]: INFO networking_nsxv3.common.synchronization [req-ab23a6e3-9d10-4d4a-95cb-b2190827d8fb req-ee4dfcd0-1a56-44ff-8bad-088fd6a217a6 service nova] Enqueued Resource ID: 226b4b5c-279d-413f-827c-2de29e2183d1 with Priority: HIGHEST for action port [ 706.670828] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_rules [ 706.670962] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_members [ 706.671097] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 226b4b5c-279d-413f-827c-2de29e2183d1 with Priority: HIGHEST for action port [ 706.671710] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.671842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.671907] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.672123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.672210] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.673130] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.673246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.673446] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-226b4b5c-279d-413f-827c-2de29e2183d1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.673548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-226b4b5c-279d-413f-827c-2de29e2183d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.673611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-226b4b5c-279d-413f-827c-2de29e2183d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.673808] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-226b4b5c-279d-413f-827c-2de29e2183d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.673894] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('226b4b5c-279d-413f-827c-2de29e2183d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.762419] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.180596] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.180596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.181351] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 226b4b5c-279d-413f-827c-2de29e2183d1 with status ACTIVE [ 707.181679] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.184029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.184029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.184029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.184029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.184029] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.184029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.184029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.184029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.184029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.184029] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.184029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.184029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.184029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.184029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.184029] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 226b4b5c-279d-413f-827c-2de29e2183d1 is going to be updated. [ 707.206842] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.206921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.206955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.207243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.207407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.207575] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-226b4b5c-279d-413f-827c-2de29e2183d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.267629] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.267918] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.268056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.268405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.268547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.268702] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 is going to be updated. [ 707.313543] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.313921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.313921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.314049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.316127] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.326336] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 in Status: IN_PROGRESS for 2s [ 707.456613] env[68109]: INFO networking_nsxv3.common.synchronization [None req-11f95a18-ef5d-4d4e-804c-2a958cca8acf None None] Enqueued Resource ID: f7028aca-153f-4f6a-bebb-1b65de5bd721 with Priority: HIGHEST for action port [ 707.456900] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7028aca-153f-4f6a-bebb-1b65de5bd721 with Priority: HIGHEST for action port [ 707.457490] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7028aca-153f-4f6a-bebb-1b65de5bd721 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.457672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7028aca-153f-4f6a-bebb-1b65de5bd721" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.457672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7028aca-153f-4f6a-bebb-1b65de5bd721" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.457924] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7028aca-153f-4f6a-bebb-1b65de5bd721" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.458011] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7028aca-153f-4f6a-bebb-1b65de5bd721',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.763519] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 707.763854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.933780] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: SUCCESS [ 707.934014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.934189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.934415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.934611] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.934729] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.934801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.934950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.935053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.935153] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.960470] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7028aca-153f-4f6a-bebb-1b65de5bd721 [ 707.960892] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.961046] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.961114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.961740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.961847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.961948] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7028aca-153f-4f6a-bebb-1b65de5bd721 already deleted. [ 707.962043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7028aca-153f-4f6a-bebb-1b65de5bd721" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.437084] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.942247] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.335205] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 in Status: SUCCESS [ 709.335408] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.444681] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.445141] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.445141] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.445141] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.445266] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.445343] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 is going to be updated. [ 709.476120] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.476120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.476120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.476120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.476120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.482569] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: IN_PROGRESS for 2s [ 709.972462] env[68109]: INFO networking_nsxv3.common.synchronization [req-fdb08b7d-50ee-49d0-afc8-fdce84131a39 req-9fbdccb8-385d-49ec-bd54-de1bff5dc1ae tempest-ServersAdminNegativeTestJSON-2123175983 tempest-ServersAdminNegativeTestJSON-2123175983-project-member] Enqueued Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_members [ 709.973142] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_members [ 709.973414] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.973562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.973663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.973830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.973999] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.974584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.974667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.975862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.975862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.975862] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.480294] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.494670] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.494895] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.495047] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.495314] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.495564] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.495745] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.495834] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.496181] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.496365] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.496608] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 710.496744] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.496869] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.496992] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.497153] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 710.497283] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.497434] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.517058] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.517257] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 710.517394] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.517573] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.517886] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-74dc5360-cd83-4c81-a583-0f3f5c342bc6 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.518083] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-74dc5360-cd83-4c81-a583-0f3f5c342bc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.518211] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-74dc5360-cd83-4c81-a583-0f3f5c342bc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.518560] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-74dc5360-cd83-4c81-a583-0f3f5c342bc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.518699] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74dc5360-cd83-4c81-a583-0f3f5c342bc6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.982401] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.020619] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.020890] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.021057] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.021405] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.021487] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.021642] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 74dc5360-cd83-4c81-a583-0f3f5c342bc6 not found, creating... [ 711.021899] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.022082] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.022209] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.022429] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.022566] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.022871] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.023066] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.023216] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.023437] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.023572] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.023713] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 74dc5360-cd83-4c81-a583-0f3f5c342bc6 is going to be created. [ 711.043892] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.044130] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.044271] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.044572] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.044810] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.045078] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-74dc5360-cd83-4c81-a583-0f3f5c342bc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.485530] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.485745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.485745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.485972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.486076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.486176] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee121dc7-4686-4564-b58a-255456cf3857 is going to be updated. [ 711.499344] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: SUCCESS [ 711.499592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.499763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.500014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.500258] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.500405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.500479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.500714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.500820] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.500952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.501084] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.514759] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.514937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.515093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.515253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.515395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.523850] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee121dc7-4686-4564-b58a-255456cf3857 in Status: IN_PROGRESS for 2s [ 711.819644] env[68109]: INFO networking_nsxv3.common.synchronization [req-fdb08b7d-50ee-49d0-afc8-fdce84131a39 req-6b078f24-202d-4061-ba08-741b7e8b09c0 service nova] Enqueued Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_rules [ 711.819826] env[68109]: INFO networking_nsxv3.common.synchronization [req-fdb08b7d-50ee-49d0-afc8-fdce84131a39 req-6b078f24-202d-4061-ba08-741b7e8b09c0 service nova] Enqueued Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_members [ 711.819963] env[68109]: INFO networking_nsxv3.common.synchronization [req-fdb08b7d-50ee-49d0-afc8-fdce84131a39 req-6b078f24-202d-4061-ba08-741b7e8b09c0 service nova] Enqueued Resource ID: 74dc5360-cd83-4c81-a583-0f3f5c342bc6 with Priority: HIGHEST for action port [ 711.820208] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_rules [ 711.820398] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_members [ 711.820516] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74dc5360-cd83-4c81-a583-0f3f5c342bc6 with Priority: HIGHEST for action port [ 711.821118] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.821330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.821330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.821509] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.821590] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.822417] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.822540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.822738] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-74dc5360-cd83-4c81-a583-0f3f5c342bc6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.823009] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74dc5360-cd83-4c81-a583-0f3f5c342bc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.823086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74dc5360-cd83-4c81-a583-0f3f5c342bc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.823526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74dc5360-cd83-4c81-a583-0f3f5c342bc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.823526] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74dc5360-cd83-4c81-a583-0f3f5c342bc6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.004601] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.004888] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.004888] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.004973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.005937] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.005937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.005937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.005937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.005937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.005937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.005937] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.005937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.005937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.006605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.006605] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.006605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.006605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.006605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.006605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.006605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.006859] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.325350] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.328020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.328020] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74dc5360-cd83-4c81-a583-0f3f5c342bc6 with status ACTIVE [ 712.328020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.328020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.328020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.328020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.328020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.328020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.328020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.328020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.328020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.328020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.328020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.328020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.328020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.328020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.328020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.328855] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74dc5360-cd83-4c81-a583-0f3f5c342bc6 is going to be updated. [ 712.351736] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.351736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.351736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.351736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.351736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.351736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74dc5360-cd83-4c81-a583-0f3f5c342bc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.380734] env[68109]: INFO networking_nsxv3.common.synchronization [req-20b45885-640a-4562-8e17-ecfdb997bbae req-5b22ba79-1175-485d-afab-d47f8b058210 tempest-TenantUsagesTestJSON-1083656779 tempest-TenantUsagesTestJSON-1083656779-project-member] Enqueued Resource ID: 9353334a-e1b0-43d9-9c87-a08b8516326e with Priority: HIGHEST for action security_group_members [ 712.381318] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9353334a-e1b0-43d9-9c87-a08b8516326e with Priority: HIGHEST for action security_group_members [ 712.381560] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9353334a-e1b0-43d9-9c87-a08b8516326e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.381680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.381745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.381985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.382156] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.382260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.382361] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.382458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.382540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.382630] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9353334a-e1b0-43d9-9c87-a08b8516326e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.508785] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7188635c-e1c3-4fba-9e1d-f639d22a02e3: rpc.has_security_group_logging(os_id): False [ 712.526779] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.526927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.527031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.527220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.527404] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.527497] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.527592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.527651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.527802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.527878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.528080] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.528308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.528308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.528365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.528824] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.528824] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.528824] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.528824] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.529189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.529189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.529189] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 is going to be updated. [ 712.594718] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.594849] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.594925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.595112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.595287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.619581] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: IN_PROGRESS for 2s [ 712.884277] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.884459] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.884562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.884809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.884908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.885129] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.885220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.885281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.885443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.885520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.885634] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9353334a-e1b0-43d9-9c87-a08b8516326e already deleted. [ 712.885706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.974951] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.975226] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.975398] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.975737] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.979098] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.979357] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.979487] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.979785] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.979940] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.980207] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.980326] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.980435] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.980537] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.980868] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 712.980868] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.980956] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.003156] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.003339] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.003490] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.003662] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.004026] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-68f70f16-adcc-4765-88cf-171acda2a72a taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.004284] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-68f70f16-adcc-4765-88cf-171acda2a72a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.004392] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-68f70f16-adcc-4765-88cf-171acda2a72a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.004670] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-68f70f16-adcc-4765-88cf-171acda2a72a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.004971] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68f70f16-adcc-4765-88cf-171acda2a72a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.508571] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.509809] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.510037] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.510330] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.510485] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.510661] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 68f70f16-adcc-4765-88cf-171acda2a72a not found, creating... [ 713.510922] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.511112] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.511261] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.511521] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.511632] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.511912] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.514099] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.514260] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.514531] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.514712] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.516335] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 68f70f16-adcc-4765-88cf-171acda2a72a is going to be created. [ 713.534299] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee121dc7-4686-4564-b58a-255456cf3857 in Status: SUCCESS [ 713.534641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.535512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.535966] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.536251] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.538217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.538217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.538217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.538217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.538217] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.540306] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.542349] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.542349] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.542349] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.542349] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.542349] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-68f70f16-adcc-4765-88cf-171acda2a72a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.039622] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.534880] env[68109]: INFO networking_nsxv3.common.synchronization [req-20b45885-640a-4562-8e17-ecfdb997bbae req-b9ab5882-3a06-4386-9226-135e06484bd5 service nova] Enqueued Resource ID: 9353334a-e1b0-43d9-9c87-a08b8516326e with Priority: HIGHEST for action security_group_rules [ 714.534880] env[68109]: INFO networking_nsxv3.common.synchronization [req-20b45885-640a-4562-8e17-ecfdb997bbae req-b9ab5882-3a06-4386-9226-135e06484bd5 service nova] Enqueued Resource ID: 9353334a-e1b0-43d9-9c87-a08b8516326e with Priority: HIGHEST for action security_group_members [ 714.535033] env[68109]: INFO networking_nsxv3.common.synchronization [req-20b45885-640a-4562-8e17-ecfdb997bbae req-b9ab5882-3a06-4386-9226-135e06484bd5 service nova] Enqueued Resource ID: 68f70f16-adcc-4765-88cf-171acda2a72a with Priority: HIGHEST for action port [ 714.535254] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9353334a-e1b0-43d9-9c87-a08b8516326e with Priority: HIGHEST for action security_group_rules [ 714.535887] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9353334a-e1b0-43d9-9c87-a08b8516326e with Priority: HIGHEST for action security_group_members [ 714.535887] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68f70f16-adcc-4765-88cf-171acda2a72a with Priority: HIGHEST for action port [ 714.536110] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9353334a-e1b0-43d9-9c87-a08b8516326e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.536110] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.536197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.536663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.536663] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9353334a-e1b0-43d9-9c87-a08b8516326e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.540184] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9353334a-e1b0-43d9-9c87-a08b8516326e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.540184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.540184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.540184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.540721] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.540721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.540721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.540721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.540721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.540941] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9353334a-e1b0-43d9-9c87-a08b8516326e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.542757] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-68f70f16-adcc-4765-88cf-171acda2a72a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.542757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68f70f16-adcc-4765-88cf-171acda2a72a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.542757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68f70f16-adcc-4765-88cf-171acda2a72a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.542757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68f70f16-adcc-4765-88cf-171acda2a72a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.542757] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68f70f16-adcc-4765-88cf-171acda2a72a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.544000] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.632602] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: SUCCESS [ 714.632889] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.044248] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9353334a-e1b0-43d9-9c87-a08b8516326e taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.044573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.045815] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68f70f16-adcc-4765-88cf-171acda2a72a with status ACTIVE [ 715.046035] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.046168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.046237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.046480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.046573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.046767] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.046898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.046987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.047187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.047298] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.047519] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.047677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.047760] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.047955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.048061] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.048242] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68f70f16-adcc-4765-88cf-171acda2a72a is going to be updated. [ 715.052945] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9353334a-e1b0-43d9-9c87-a08b8516326e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.059012] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.059148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.059258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.059576] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.059576] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.059726] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee121dc7-4686-4564-b58a-255456cf3857 is going to be updated. [ 715.082307] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.082510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.082593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.082838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.082989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.083532] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68f70f16-adcc-4765-88cf-171acda2a72a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.088099] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.088271] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.088373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.088583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.088727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.100696] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee121dc7-4686-4564-b58a-255456cf3857 in Status: IN_PROGRESS for 2s [ 715.562410] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9353334a-e1b0-43d9-9c87-a08b8516326e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.068872] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.069720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.069720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.069720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.069720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.070902] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9353334a-e1b0-43d9-9c87-a08b8516326e is going to be created. [ 716.096510] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.096720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.096789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.097043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.097211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.108467] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: UNINITIALIZED for 2s [ 717.118181] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee121dc7-4686-4564-b58a-255456cf3857 in Status: SUCCESS [ 717.118508] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.118810] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.119177] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.119481] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.119702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.119828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.120132] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.120291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.120548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.120729] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.623031] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.623213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.623293] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.623577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.623868] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.623868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.623868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.624058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.624130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.624226] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.624428] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.624515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.624515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.624963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.624963] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.624963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.624963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.625344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.625344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.625344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.625344] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.118193] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: SUCCESS [ 718.118462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.118598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.118826] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.119038] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.119168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.119224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.119380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.119460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.119547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.119639] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9353334a-e1b0-43d9-9c87-a08b8516326e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.127984] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee121dc7-4686-4564-b58a-255456cf3857: rpc.has_security_group_logging(os_id): False [ 718.143399] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.143399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.143572] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.143713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.143812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.144107] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.144206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.144273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.144518] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.144582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.144740] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.144862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.144905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.145088] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.145195] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.145391] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.145489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.145552] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.145695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.145772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.145859] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee121dc7-4686-4564-b58a-255456cf3857 is going to be updated. [ 718.201119] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.201313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.201355] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.201543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.201681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.211900] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee121dc7-4686-4564-b58a-255456cf3857 in Status: IN_PROGRESS for 2s [ 718.626628] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9353334a-e1b0-43d9-9c87-a08b8516326e taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.626795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.626872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.627128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.627302] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.627406] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.627469] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.627624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.627713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.627805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.627949] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9353334a-e1b0-43d9-9c87-a08b8516326e taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.628058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.628119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.628265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.628399] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.628491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.628550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.628686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.628762] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.628844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.628935] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9353334a-e1b0-43d9-9c87-a08b8516326e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.132990] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9353334a-e1b0-43d9-9c87-a08b8516326e: rpc.has_security_group_logging(os_id): False [ 719.153220] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.153220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.153220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.153220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.153220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.153220] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.153220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.153220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.153220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.153220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.153220] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.153220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.153220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.153220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.153220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.153689] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.153689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.153689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.153689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.153689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.153689] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9353334a-e1b0-43d9-9c87-a08b8516326e is going to be created. [ 719.206334] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.206486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.206556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.206770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.206949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.219478] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 2s [ 719.238083] env[68109]: INFO networking_nsxv3.common.synchronization [None req-8217948f-9bb9-4134-8ebf-833b394b12ff None None] Enqueued Resource ID: f75a012d-6bad-447d-9f2b-3e1481f6bd78 with Priority: HIGHEST for action port [ 719.239616] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f75a012d-6bad-447d-9f2b-3e1481f6bd78 with Priority: HIGHEST for action port [ 719.239616] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f75a012d-6bad-447d-9f2b-3e1481f6bd78 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.239616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f75a012d-6bad-447d-9f2b-3e1481f6bd78" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.239616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f75a012d-6bad-447d-9f2b-3e1481f6bd78" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.240190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f75a012d-6bad-447d-9f2b-3e1481f6bd78" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.240282] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f75a012d-6bad-447d-9f2b-3e1481f6bd78',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.743805] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f75a012d-6bad-447d-9f2b-3e1481f6bd78 [ 719.744053] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.744189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.744254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.745138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.745138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.745138] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f75a012d-6bad-447d-9f2b-3e1481f6bd78 already deleted. [ 719.745138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f75a012d-6bad-447d-9f2b-3e1481f6bd78" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.226898] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee121dc7-4686-4564-b58a-255456cf3857 in Status: SUCCESS [ 720.226898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.233162] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 4s [ 721.316940] env[68109]: INFO networking_nsxv3.common.synchronization [req-1f3b91d6-456e-4677-820b-9b54e14638b0 req-8668fb59-58ad-46f4-b9a2-e4f859dcd73b tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 721.317461] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 721.317753] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.317877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.317959] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.318825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.321030] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.321203] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.321844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.322468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.322468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.322468] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.591683] env[68109]: INFO networking_nsxv3.common.synchronization [None req-9ee90b2e-0842-4a4e-810f-4434463775f5 None None] Enqueued Resource ID: 32ed2dd7-689d-44bc-986c-9b6056de6af0 with Priority: HIGHEST for action port [ 721.591995] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ed2dd7-689d-44bc-986c-9b6056de6af0 with Priority: HIGHEST for action port [ 721.592458] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-32ed2dd7-689d-44bc-986c-9b6056de6af0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.592584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32ed2dd7-689d-44bc-986c-9b6056de6af0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.592653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32ed2dd7-689d-44bc-986c-9b6056de6af0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.593054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32ed2dd7-689d-44bc-986c-9b6056de6af0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.593054] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32ed2dd7-689d-44bc-986c-9b6056de6af0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.635387] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.635575] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-134" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.635696] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-134" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.636058] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-134" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.636326] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.637170] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.637170] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.637170] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.637170] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.637967] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.638864] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.639359] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.639359] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.639359] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.639359] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.639679] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.658575] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.658799] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 721.659188] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.659441] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-134" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.659837] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.660071] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.660242] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.660597] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.660825] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c29d9e7-4c06-4801-b7c8-28350bfbc29d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.827549] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.827549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.827549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.827549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.827549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.827549] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.827549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.827549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.827549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.828121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.828121] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f already deleted. [ 721.828121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.097024] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32ed2dd7-689d-44bc-986c-9b6056de6af0 [ 722.097024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.097024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.097024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.097024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.097024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.097024] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32ed2dd7-689d-44bc-986c-9b6056de6af0 already deleted. [ 722.097024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32ed2dd7-689d-44bc-986c-9b6056de6af0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.163923] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.164465] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.164621] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.164964] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.165085] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.165253] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 7c29d9e7-4c06-4801-b7c8-28350bfbc29d not found, creating... [ 722.165542] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.165714] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.165822] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.166054] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.166198] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.166488] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.166648] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.166815] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.166979] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.167488] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.167907] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 7c29d9e7-4c06-4801-b7c8-28350bfbc29d is going to be created. [ 722.192319] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.194018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.194018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.194018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.194241] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.194630] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.872403] env[68109]: INFO networking_nsxv3.common.synchronization [req-1f3b91d6-456e-4677-820b-9b54e14638b0 req-ad8f1f5b-aa7b-409d-b395-760fee982e08 service nova] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_rules [ 722.872669] env[68109]: INFO networking_nsxv3.common.synchronization [req-1f3b91d6-456e-4677-820b-9b54e14638b0 req-ad8f1f5b-aa7b-409d-b395-760fee982e08 service nova] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 722.872669] env[68109]: INFO networking_nsxv3.common.synchronization [req-1f3b91d6-456e-4677-820b-9b54e14638b0 req-ad8f1f5b-aa7b-409d-b395-760fee982e08 service nova] Enqueued Resource ID: 7c29d9e7-4c06-4801-b7c8-28350bfbc29d with Priority: HIGHEST for action port [ 722.873250] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_rules [ 722.873342] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 722.873439] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c29d9e7-4c06-4801-b7c8-28350bfbc29d with Priority: HIGHEST for action port [ 722.873713] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.873885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.873885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.874201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.874438] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.875968] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.876345] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.876456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.876690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.876914] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.877146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.877266] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.877413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.878365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.878365] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.878643] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.878788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.878885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.882077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.882077] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c29d9e7-4c06-4801-b7c8-28350bfbc29d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.244842] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 6s [ 723.382641] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.383523] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.383629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.383794] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c29d9e7-4c06-4801-b7c8-28350bfbc29d with status ACTIVE [ 723.383950] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.384594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.384594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.384594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.384594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.384594] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.384870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.384870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.384870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.384982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.385099] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.386144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.386144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.386144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.386144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.386144] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c29d9e7-4c06-4801-b7c8-28350bfbc29d is going to be updated. [ 723.404853] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.405027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.405076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.405607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.405607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.405607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.888332] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.939066] env[68109]: INFO networking_nsxv3.common.synchronization [req-9c74ec61-8148-4ce4-9f20-041ba88bede7 req-d0951765-7e10-431c-8bee-15eee2260be4 tempest-ServerMetadataNegativeTestJSON-1194638423 tempest-ServerMetadataNegativeTestJSON-1194638423-project-member] Enqueued Resource ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 with Priority: HIGHEST for action security_group_members [ 723.939066] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 with Priority: HIGHEST for action security_group_members [ 723.939066] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-37f5dbb0-40eb-4b23-be82-699bd65bcb79 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.939066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.939066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.940240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.940240] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.940240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.940240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.940240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.940240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.940240] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37f5dbb0-40eb-4b23-be82-699bd65bcb79',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.277026] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.277026] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-801" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.277026] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-801" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.277026] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-801" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.277026] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.277026] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.277691] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.278103] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.278414] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.278947] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 724.279958] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.279958] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.279958] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.279958] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 724.279958] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.280259] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.299719] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.299719] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 724.299853] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.300056] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-801" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.300769] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-fe84dc87-89dc-42de-913b-69e4a7f63d67 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.300769] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-fe84dc87-89dc-42de-913b-69e4a7f63d67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.300906] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-fe84dc87-89dc-42de-913b-69e4a7f63d67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.301269] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-fe84dc87-89dc-42de-913b-69e4a7f63d67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.301414] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe84dc87-89dc-42de-913b-69e4a7f63d67',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.394429] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.394648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.394728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.394968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.395052] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.395172] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be created. [ 724.416053] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.416231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.416285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.420270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.420455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.429515] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: UNINITIALIZED for 2s [ 724.442150] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.442328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.442411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.442674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.442842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.443123] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.443260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.443348] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.443545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.443660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.443773] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 already deleted. [ 724.444725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.804317] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.804540] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.804669] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.805059] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.805256] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.805445] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port fe84dc87-89dc-42de-913b-69e4a7f63d67 not found, creating... [ 724.805724] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.805884] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.806010] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.806242] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.806382] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.806657] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.806809] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.806935] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.807236] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.807337] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.807477] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: fe84dc87-89dc-42de-913b-69e4a7f63d67 is going to be created. [ 724.827860] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.828085] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.828255] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.828528] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.828752] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.828986] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-fe84dc87-89dc-42de-913b-69e4a7f63d67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.130533] env[68109]: INFO networking_nsxv3.common.synchronization [req-a53acc21-8720-44ef-8225-b44d22385fdd req-c852d790-b7c3-4cf9-9993-229453ef57c2 tempest-TenantUsagesTestJSON-1083656779 tempest-TenantUsagesTestJSON-1083656779-project-member] Enqueued Resource ID: 9353334a-e1b0-43d9-9c87-a08b8516326e with Priority: HIGHEST for action security_group_members [ 725.131058] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9353334a-e1b0-43d9-9c87-a08b8516326e with Priority: HIGHEST for action security_group_members [ 725.131371] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9353334a-e1b0-43d9-9c87-a08b8516326e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.131491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.131554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.131765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.131919] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.132095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.132163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.132329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.132459] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.132503] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9353334a-e1b0-43d9-9c87-a08b8516326e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.256606] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 8s [ 725.514025] env[68109]: INFO networking_nsxv3.common.synchronization [req-9c74ec61-8148-4ce4-9f20-041ba88bede7 req-a5a1cc4f-a2ed-45d0-b522-7b548ec03493 service nova] Enqueued Resource ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 with Priority: HIGHEST for action security_group_rules [ 725.514025] env[68109]: INFO networking_nsxv3.common.synchronization [req-9c74ec61-8148-4ce4-9f20-041ba88bede7 req-a5a1cc4f-a2ed-45d0-b522-7b548ec03493 service nova] Enqueued Resource ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 with Priority: HIGHEST for action security_group_members [ 725.514025] env[68109]: INFO networking_nsxv3.common.synchronization [req-9c74ec61-8148-4ce4-9f20-041ba88bede7 req-a5a1cc4f-a2ed-45d0-b522-7b548ec03493 service nova] Enqueued Resource ID: fe84dc87-89dc-42de-913b-69e4a7f63d67 with Priority: HIGHEST for action port [ 725.514025] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 with Priority: HIGHEST for action security_group_rules [ 725.514025] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 with Priority: HIGHEST for action security_group_members [ 725.514025] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe84dc87-89dc-42de-913b-69e4a7f63d67 with Priority: HIGHEST for action port [ 725.514025] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37f5dbb0-40eb-4b23-be82-699bd65bcb79 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.514025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.514025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.514025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.514025] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37f5dbb0-40eb-4b23-be82-699bd65bcb79',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.514025] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-37f5dbb0-40eb-4b23-be82-699bd65bcb79 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.514025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.514025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.514025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.514025] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.514025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.514025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.514025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.514025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.515380] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37f5dbb0-40eb-4b23-be82-699bd65bcb79',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.515380] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe84dc87-89dc-42de-913b-69e4a7f63d67 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.515380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe84dc87-89dc-42de-913b-69e4a7f63d67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.515380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe84dc87-89dc-42de-913b-69e4a7f63d67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.515380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe84dc87-89dc-42de-913b-69e4a7f63d67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.515380] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe84dc87-89dc-42de-913b-69e4a7f63d67',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.636233] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.636395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.636462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.636683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.636794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.636984] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.637519] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.637519] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.637519] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.637519] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.637519] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9353334a-e1b0-43d9-9c87-a08b8516326e is going to be updated. [ 725.663811] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.663811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.664159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.664242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.664382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.674972] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 2s [ 725.776184] env[68109]: INFO networking_nsxv3.common.synchronization [req-c1037ea5-d04f-452a-a330-526d48213b71 req-449c4ecc-cfcf-4a62-b46a-ddae350f9052 tempest-DeleteServersTestJSON-2063667557 tempest-DeleteServersTestJSON-2063667557-project-member] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 725.776694] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 725.776999] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.781717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.781717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.781717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.782368] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.782568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.783067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.784133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.784133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.784133] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.016017] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-37f5dbb0-40eb-4b23-be82-699bd65bcb79 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.016238] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.016454] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe84dc87-89dc-42de-913b-69e4a7f63d67 with status ACTIVE [ 726.017037] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.017192] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.017264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.017484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.017549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.017721] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.017813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.017862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.018014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.018095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.018310] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.018360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.018393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.018529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.018600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.018677] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe84dc87-89dc-42de-913b-69e4a7f63d67 is going to be updated. [ 726.019773] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37f5dbb0-40eb-4b23-be82-699bd65bcb79',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.038928] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.039094] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.039163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.039363] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.039496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.039654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe84dc87-89dc-42de-913b-69e4a7f63d67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.287241] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.287547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.287547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.287762] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.287807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.288069] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.288134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.288205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.288387] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.288561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.288561] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 726.315312] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.315312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.315312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.315713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.315713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.324168] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 726.442747] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 726.442747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.442747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.442747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.442747] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.442747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.442747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.442747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.442747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.442747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.442747] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.522693] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37f5dbb0-40eb-4b23-be82-699bd65bcb79',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.944401] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.944558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.944627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.944844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.945408] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.945516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.945588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.945752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.945841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.945933] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.946094] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.946187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.946246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.946386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.946531] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.946605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.946664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.946797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.946884] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.946966] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.947933] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.027528] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.027689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.027754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.027969] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.028080] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.028181] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 is going to be created. [ 727.068202] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.068494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.068573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.068780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.068949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.088650] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 in Status: UNINITIALIZED for 2s [ 727.107945] env[68109]: INFO networking_nsxv3.common.synchronization [req-9c4b71ca-898a-46f5-ba7f-6f921b378a16 req-efd34c41-7cdd-4fb8-a0c6-7a1e057626bf tempest-ServersAdminNegativeTestJSON-2123175983 tempest-ServersAdminNegativeTestJSON-2123175983-project-member] Enqueued Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_members [ 727.108559] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_members [ 727.108880] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.109034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.109164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.109332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.109488] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.109672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.109672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.109820] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.109861] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.109962] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.272017] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 10s [ 727.450339] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a8ad551-9243-4b5e-a0bd-acf823c5b01f: rpc.has_security_group_logging(os_id): False [ 727.467321] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.467980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.467980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.467980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.467980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.468490] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.468626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.468720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.468994] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.469502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.469502] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.469502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.469502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.469868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.469974] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.470206] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.470339] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.470596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.470650] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.470780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.472874] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be created. [ 727.523792] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.524034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.524116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.524328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.524504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.534286] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 727.612052] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.687907] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: SUCCESS [ 727.688104] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9353334a-e1b0-43d9-9c87-a08b8516326e deletion is rescheduled due to dependency. [ 727.688219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.114107] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.268984] env[68109]: INFO networking_nsxv3.common.synchronization [None req-60fe6f9e-0f49-493f-8042-f9cb352b1532 None None] Enqueued Resource ID: ba5f3877-b4e5-4336-9c6f-92e7db43c598 with Priority: HIGHEST for action port [ 728.268984] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba5f3877-b4e5-4336-9c6f-92e7db43c598 with Priority: HIGHEST for action port [ 728.269269] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba5f3877-b4e5-4336-9c6f-92e7db43c598 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.269396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba5f3877-b4e5-4336-9c6f-92e7db43c598" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.269464] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba5f3877-b4e5-4336-9c6f-92e7db43c598" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.269730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba5f3877-b4e5-4336-9c6f-92e7db43c598" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.269813] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba5f3877-b4e5-4336-9c6f-92e7db43c598',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.333617] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 728.334027] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 deletion is rescheduled due to dependency. [ 728.334027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.616643] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.616936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.616936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.617078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.617162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.617260] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee121dc7-4686-4564-b58a-255456cf3857 is going to be updated. [ 728.641359] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.641495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.644206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.644206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.644206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.649759] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee121dc7-4686-4564-b58a-255456cf3857 in Status: IN_PROGRESS for 2s [ 728.771080] env[68109]: INFO networking_nsxv3.common.synchronization [req-9c8be0e8-5ab2-4b80-bc9a-d1e2badc756b req-f4626c0d-79d0-4ee4-b010-09750861eead tempest-ServerAddressesNegativeTestJSON-1418903357 tempest-ServerAddressesNegativeTestJSON-1418903357-project-member] Enqueued Resource ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad with Priority: HIGHEST for action security_group_members [ 728.771593] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad with Priority: HIGHEST for action security_group_members [ 728.771886] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.772015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.772089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.772335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.772487] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.772581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.772638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.772786] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.772871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.772993] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaac1254-fb03-45ff-9ca3-f0edf21f5dad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.778242] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba5f3877-b4e5-4336-9c6f-92e7db43c598 [ 728.778418] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.778525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.778596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.778745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.778864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.778906] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba5f3877-b4e5-4336-9c6f-92e7db43c598 already deleted. [ 728.778988] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba5f3877-b4e5-4336-9c6f-92e7db43c598" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.104604] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 in Status: SUCCESS [ 729.104821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.105692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.105692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.105692] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.105692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.105692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.105924] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.105924] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.105924] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.106118] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37f5dbb0-40eb-4b23-be82-699bd65bcb79',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.281372] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 12s [ 729.282718] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.282718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.282718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.282718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.282718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.282718] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.282718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.282718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.283181] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.283181] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.283250] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad already deleted. [ 729.284346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.547040] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 729.547310] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.607556] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-793 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.609013] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-793" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.609013] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-793" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.609711] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-793" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.609999] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.610190] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.610311] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.610551] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.610687] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.610890] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.611051] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.611169] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.611276] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.611400] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.611508] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.611652] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.613228] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-37f5dbb0-40eb-4b23-be82-699bd65bcb79 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.613340] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.613491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.613585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.613733] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.613835] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.613934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.614866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.614866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.614866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.614866] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-37f5dbb0-40eb-4b23-be82-699bd65bcb79 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.614866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.614866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.614866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.614866] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.614866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.615151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.615151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.615151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.615230] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.615313] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37f5dbb0-40eb-4b23-be82-699bd65bcb79',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.781337] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.781629] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.170 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 729.781629] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.781827] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-793" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.782195] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-71adaff0-c470-4004-8dfb-c2580ee16762 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.782369] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-71adaff0-c470-4004-8dfb-c2580ee16762" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.782532] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-71adaff0-c470-4004-8dfb-c2580ee16762" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.782782] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-71adaff0-c470-4004-8dfb-c2580ee16762" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.782919] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71adaff0-c470-4004-8dfb-c2580ee16762',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.118840] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37f5dbb0-40eb-4b23-be82-699bd65bcb79: rpc.has_security_group_logging(os_id): False [ 730.136797] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.136952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.137034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.137248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.137335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.137545] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.137645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.137705] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.137932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.137932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.138115] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.138207] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.138267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.138402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.138474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.138645] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.138733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.138790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.138921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.138991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.141744] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 is going to be created. [ 730.194966] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.195185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.195185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.195405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.195580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.205085] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 in Status: IN_PROGRESS for 2s [ 730.287538] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.287826] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.288128] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.288605] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.288857] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.289115] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 71adaff0-c470-4004-8dfb-c2580ee16762 not found, creating... [ 730.289545] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.289747] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.289932] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.290274] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.290474] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.290937] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.291239] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.291529] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.291857] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.292088] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.292287] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 71adaff0-c470-4004-8dfb-c2580ee16762 is going to be created. [ 730.314157] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.314442] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.314613] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.314956] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.315275] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.315571] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-71adaff0-c470-4004-8dfb-c2580ee16762" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.659757] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee121dc7-4686-4564-b58a-255456cf3857 in Status: SUCCESS [ 730.660691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.737241] env[68109]: INFO networking_nsxv3.common.synchronization [None req-674f97ae-80f5-440c-adfb-03bf1d87cf4a None None] Enqueued Resource ID: 380aeaed-4504-4bba-9eef-10a32d8552b1 with Priority: HIGHEST for action port [ 730.737496] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380aeaed-4504-4bba-9eef-10a32d8552b1 with Priority: HIGHEST for action port [ 730.738261] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-380aeaed-4504-4bba-9eef-10a32d8552b1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.738395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-380aeaed-4504-4bba-9eef-10a32d8552b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.738460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-380aeaed-4504-4bba-9eef-10a32d8552b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.738726] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-380aeaed-4504-4bba-9eef-10a32d8552b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.738849] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('380aeaed-4504-4bba-9eef-10a32d8552b1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.125104] env[68109]: INFO networking_nsxv3.common.synchronization [req-9c8be0e8-5ab2-4b80-bc9a-d1e2badc756b req-ff5e4a20-a50b-4aea-a74f-cffc92c44a85 service nova] Enqueued Resource ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad with Priority: HIGHEST for action security_group_rules [ 731.125458] env[68109]: INFO networking_nsxv3.common.synchronization [req-9c8be0e8-5ab2-4b80-bc9a-d1e2badc756b req-ff5e4a20-a50b-4aea-a74f-cffc92c44a85 service nova] Enqueued Resource ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad with Priority: HIGHEST for action security_group_members [ 731.125458] env[68109]: INFO networking_nsxv3.common.synchronization [req-9c8be0e8-5ab2-4b80-bc9a-d1e2badc756b req-ff5e4a20-a50b-4aea-a74f-cffc92c44a85 service nova] Enqueued Resource ID: 71adaff0-c470-4004-8dfb-c2580ee16762 with Priority: HIGHEST for action port [ 731.125732] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad with Priority: HIGHEST for action security_group_rules [ 731.125874] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad with Priority: HIGHEST for action security_group_members [ 731.125973] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71adaff0-c470-4004-8dfb-c2580ee16762 with Priority: HIGHEST for action port [ 731.126534] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaac1254-fb03-45ff-9ca3-f0edf21f5dad taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.127031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.127031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.130531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.130630] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaac1254-fb03-45ff-9ca3-f0edf21f5dad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.131549] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.131671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.131737] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.131912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.132535] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.132535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.132535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.132535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.132535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.132535] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaac1254-fb03-45ff-9ca3-f0edf21f5dad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.133294] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-71adaff0-c470-4004-8dfb-c2580ee16762 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.133445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71adaff0-c470-4004-8dfb-c2580ee16762" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.133476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71adaff0-c470-4004-8dfb-c2580ee16762" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.133848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71adaff0-c470-4004-8dfb-c2580ee16762" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.133848] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71adaff0-c470-4004-8dfb-c2580ee16762',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.245197] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 380aeaed-4504-4bba-9eef-10a32d8552b1 [ 731.245432] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.245579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.245639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.245835] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.245925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.246025] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:380aeaed-4504-4bba-9eef-10a32d8552b1 already deleted. [ 731.246105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-380aeaed-4504-4bba-9eef-10a32d8552b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.292779] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 14s [ 731.396101] env[68109]: INFO networking_nsxv3.common.synchronization [req-196c17e7-d0cf-4232-bcb2-120184750079 req-49210426-12d7-44bf-9b82-c3bc8da715a1 tempest-ServerDiskConfigTestJSON-1064584538 tempest-ServerDiskConfigTestJSON-1064584538-project-member] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 731.396615] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 731.396917] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.397058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.397126] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.397322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.397668] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.397800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.397868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.398043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.398132] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.398230] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.635592] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.635779] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.635961] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aaac1254-fb03-45ff-9ca3-f0edf21f5dad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.636909] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71adaff0-c470-4004-8dfb-c2580ee16762 with status ACTIVE [ 731.637620] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.637795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.638060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.639017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.639017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.639017] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.639017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.639017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.639017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.639351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.639351] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.639420] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.640055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.640055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.640055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.640055] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71adaff0-c470-4004-8dfb-c2580ee16762 is going to be updated. [ 731.658666] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.658815] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.658955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.659254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.659254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.659441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71adaff0-c470-4004-8dfb-c2580ee16762" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.687061] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-332 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.687186] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.687323] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.687709] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.688687] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.688687] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.688687] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.688687] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.688687] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.688687] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.688962] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.688962] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.688962] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.689140] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.689171] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.689303] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.705951] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.706189] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 731.706390] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.706596] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.706955] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-7975b825-d6be-4abe-a60b-7638f48d89cb taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.707195] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-7975b825-d6be-4abe-a60b-7638f48d89cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.707346] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-7975b825-d6be-4abe-a60b-7638f48d89cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.707718] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-7975b825-d6be-4abe-a60b-7638f48d89cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.707905] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7975b825-d6be-4abe-a60b-7638f48d89cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.900496] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.900682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.900759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.901016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.901124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.901358] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.901465] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.901534] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.901748] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.901876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.901980] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 731.927093] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.927305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.927401] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.927690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.927880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.935957] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 732.142531] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aaac1254-fb03-45ff-9ca3-f0edf21f5dad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.212726] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.212726] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.212726] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.212726] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.213131] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.213447] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 7975b825-d6be-4abe-a60b-7638f48d89cb not found, creating... [ 732.213835] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.214222] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.214477] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.214822] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.218018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.218018] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.218018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.218018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.218018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.218018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.218018] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 7975b825-d6be-4abe-a60b-7638f48d89cb is going to be created. [ 732.218018] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 in Status: SUCCESS [ 732.218631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.237937] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.240631] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.240795] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.241132] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.241376] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.241605] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-7975b825-d6be-4abe-a60b-7638f48d89cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.647276] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.647276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.647276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.647276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.647276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.647276] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad is going to be created. [ 732.678875] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.678875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.678875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.678875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.678875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.689740] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad in Status: UNINITIALIZED for 2s [ 732.939239] env[68109]: INFO networking_nsxv3.common.synchronization [req-196c17e7-d0cf-4232-bcb2-120184750079 req-eba62589-96a3-4d59-a936-e4fc2ca3b319 service nova] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_rules [ 732.939239] env[68109]: INFO networking_nsxv3.common.synchronization [req-196c17e7-d0cf-4232-bcb2-120184750079 req-eba62589-96a3-4d59-a936-e4fc2ca3b319 service nova] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 732.939239] env[68109]: INFO networking_nsxv3.common.synchronization [req-196c17e7-d0cf-4232-bcb2-120184750079 req-eba62589-96a3-4d59-a936-e4fc2ca3b319 service nova] Enqueued Resource ID: 7975b825-d6be-4abe-a60b-7638f48d89cb with Priority: HIGHEST for action port [ 732.939239] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_rules [ 732.939239] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 732.939239] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7975b825-d6be-4abe-a60b-7638f48d89cb with Priority: HIGHEST for action port [ 732.940201] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.940630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.940630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.940630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.940830] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.941527] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.941626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.941871] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-7975b825-d6be-4abe-a60b-7638f48d89cb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.941952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7975b825-d6be-4abe-a60b-7638f48d89cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.941989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7975b825-d6be-4abe-a60b-7638f48d89cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.942167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7975b825-d6be-4abe-a60b-7638f48d89cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.942246] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7975b825-d6be-4abe-a60b-7638f48d89cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.304989] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 16s [ 733.418068] env[68109]: INFO networking_nsxv3.common.synchronization [req-29343475-cb0f-4c42-9d08-ced9461dc02b req-b087b2c2-e0bf-4b1c-ac43-f122427df504 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGHEST for action security_group_members [ 733.418278] env[68109]: INFO networking_nsxv3.common.synchronization [req-29343475-cb0f-4c42-9d08-ced9461dc02b req-b087b2c2-e0bf-4b1c-ac43-f122427df504 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 733.418787] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGHEST for action security_group_members [ 733.418946] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 733.419227] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.419310] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.419364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.419619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.419780] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.419879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.419942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.420102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.420184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.420277] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.421590] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.421726] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.421788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.421903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.422053] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.422153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.422205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.422346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.422423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.422696] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.444391] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.444538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.444690] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7975b825-d6be-4abe-a60b-7638f48d89cb with status ACTIVE [ 733.444846] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.444949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.445035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.445624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.445740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.445920] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.446026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.446088] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.446253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.446327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.446503] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.446593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.446651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.446787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.446859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.446941] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7975b825-d6be-4abe-a60b-7638f48d89cb is going to be updated. [ 733.466539] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.466675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.466740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.466962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.467112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.467263] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7975b825-d6be-4abe-a60b-7638f48d89cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.499830] env[68109]: INFO networking_nsxv3.common.synchronization [req-29343475-cb0f-4c42-9d08-ced9461dc02b req-b087b2c2-e0bf-4b1c-ac43-f122427df504 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGHEST for action security_group_rules [ 733.500021] env[68109]: INFO networking_nsxv3.common.synchronization [req-29343475-cb0f-4c42-9d08-ced9461dc02b req-b087b2c2-e0bf-4b1c-ac43-f122427df504 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGHEST for action security_group_members [ 733.500391] env[68109]: INFO networking_nsxv3.common.synchronization [req-29343475-cb0f-4c42-9d08-ced9461dc02b req-b087b2c2-e0bf-4b1c-ac43-f122427df504 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_rules [ 733.500391] env[68109]: INFO networking_nsxv3.common.synchronization [req-29343475-cb0f-4c42-9d08-ced9461dc02b req-b087b2c2-e0bf-4b1c-ac43-f122427df504 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 733.500391] env[68109]: INFO networking_nsxv3.common.synchronization [req-29343475-cb0f-4c42-9d08-ced9461dc02b req-b087b2c2-e0bf-4b1c-ac43-f122427df504 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 7c29d9e7-4c06-4801-b7c8-28350bfbc29d with Priority: HIGHEST for action port [ 733.500951] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGHEST for action security_group_rules [ 733.501099] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_rules [ 733.501198] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c29d9e7-4c06-4801-b7c8-28350bfbc29d with Priority: HIGHEST for action port [ 733.501291] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGHEST for action security_group_members [ 733.501379] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 733.501646] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.501965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.501965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.502646] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.502744] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.503646] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.504209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.504326] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.504493] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.504573] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.508393] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.508393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.508393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.508393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.508393] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c29d9e7-4c06-4801-b7c8-28350bfbc29d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.508833] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.508833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.509028] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.509028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.922576] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.925890] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.945152] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 733.945414] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 deletion is rescheduled due to dependency. [ 733.945463] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.945605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.945800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.945975] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.946104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.946168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.946319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.946400] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.946675] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.011759] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c29d9e7-4c06-4801-b7c8-28350bfbc29d with status ACTIVE [ 734.012137] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.012365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.012443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.012744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.012886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.013173] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.013330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.013433] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.013677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.013808] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.014115] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.014278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.014384] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.014598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.014725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.014856] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c29d9e7-4c06-4801-b7c8-28350bfbc29d is going to be updated. [ 734.017320] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.017505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.017860] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.018042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.037126] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.037385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.037498] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.037767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.038302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.038302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.124098] env[68109]: INFO networking_nsxv3.common.synchronization [req-a40b7726-642c-4137-b516-c3ed058a3b20 req-8b2ff62d-9832-4316-9fd4-81f5ca0868f7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 9e88ca4b-470a-485c-b906-6c8d635109cb with Priority: HIGHEST for action security_group_members [ 734.124282] env[68109]: INFO networking_nsxv3.common.synchronization [req-a40b7726-642c-4137-b516-c3ed058a3b20 req-8b2ff62d-9832-4316-9fd4-81f5ca0868f7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGHEST for action security_group_members [ 734.124429] env[68109]: INFO networking_nsxv3.common.synchronization [req-a40b7726-642c-4137-b516-c3ed058a3b20 req-8b2ff62d-9832-4316-9fd4-81f5ca0868f7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 734.124930] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e88ca4b-470a-485c-b906-6c8d635109cb with Priority: HIGHEST for action security_group_members [ 734.125084] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGHEST for action security_group_members [ 734.125185] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 734.125459] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e88ca4b-470a-485c-b906-6c8d635109cb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.125551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.125619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.125865] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.126019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.126202] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.126289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.126501] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.126683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.126802] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e88ca4b-470a-485c-b906-6c8d635109cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.127621] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.127756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.127971] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.128091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.233838] env[68109]: INFO networking_nsxv3.common.synchronization [req-a40b7726-642c-4137-b516-c3ed058a3b20 req-8b2ff62d-9832-4316-9fd4-81f5ca0868f7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGHEST for action security_group_rules [ 734.234054] env[68109]: INFO networking_nsxv3.common.synchronization [req-a40b7726-642c-4137-b516-c3ed058a3b20 req-8b2ff62d-9832-4316-9fd4-81f5ca0868f7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGHEST for action security_group_members [ 734.234209] env[68109]: INFO networking_nsxv3.common.synchronization [req-a40b7726-642c-4137-b516-c3ed058a3b20 req-8b2ff62d-9832-4316-9fd4-81f5ca0868f7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_rules [ 734.234357] env[68109]: INFO networking_nsxv3.common.synchronization [req-a40b7726-642c-4137-b516-c3ed058a3b20 req-8b2ff62d-9832-4316-9fd4-81f5ca0868f7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 734.234493] env[68109]: INFO networking_nsxv3.common.synchronization [req-a40b7726-642c-4137-b516-c3ed058a3b20 req-8b2ff62d-9832-4316-9fd4-81f5ca0868f7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 9e88ca4b-470a-485c-b906-6c8d635109cb with Priority: HIGHEST for action security_group_rules [ 734.234931] env[68109]: INFO networking_nsxv3.common.synchronization [req-a40b7726-642c-4137-b516-c3ed058a3b20 req-8b2ff62d-9832-4316-9fd4-81f5ca0868f7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 9e88ca4b-470a-485c-b906-6c8d635109cb with Priority: HIGHEST for action security_group_members [ 734.235360] env[68109]: INFO networking_nsxv3.common.synchronization [req-a40b7726-642c-4137-b516-c3ed058a3b20 req-8b2ff62d-9832-4316-9fd4-81f5ca0868f7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 7c29d9e7-4c06-4801-b7c8-28350bfbc29d with Priority: HIGHEST for action port [ 734.235904] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGHEST for action security_group_rules [ 734.236093] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_rules [ 734.236295] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e88ca4b-470a-485c-b906-6c8d635109cb with Priority: HIGHEST for action security_group_members [ 734.236411] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c29d9e7-4c06-4801-b7c8-28350bfbc29d with Priority: HIGHEST for action port [ 734.236573] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e88ca4b-470a-485c-b906-6c8d635109cb with Priority: HIGHEST for action security_group_rules [ 734.236688] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGHEST for action security_group_members [ 734.236800] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 734.237134] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.237290] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.237517] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.237627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.237827] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e88ca4b-470a-485c-b906-6c8d635109cb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.237931] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.238163] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.238397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.238496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.238716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.239082] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c29d9e7-4c06-4801-b7c8-28350bfbc29d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.239932] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e88ca4b-470a-485c-b906-6c8d635109cb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.240129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.240215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.240476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.240577] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e88ca4b-470a-485c-b906-6c8d635109cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.241590] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.241721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.242064] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.242199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.424187] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.429081] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.448135] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.630021] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e88ca4b-470a-485c-b906-6c8d635109cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.699288] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad in Status: SUCCESS [ 734.699599] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.699934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.700120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.700347] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.700488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.700585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.700780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.700869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.700987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.701106] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aaac1254-fb03-45ff-9ca3-f0edf21f5dad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.743500] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c29d9e7-4c06-4801-b7c8-28350bfbc29d with status ACTIVE [ 734.743800] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.743951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.744061] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.744294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.744391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.744570] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.744718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.744807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.745069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.745213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.745485] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.745681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.745762] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.745911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.745988] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.746093] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c29d9e7-4c06-4801-b7c8-28350bfbc29d is going to be updated. [ 734.747479] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e88ca4b-470a-485c-b906-6c8d635109cb taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.747567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.767608] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.767766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.767802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.768034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.768201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.768430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c29d9e7-4c06-4801-b7c8-28350bfbc29d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.926468] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.926719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.926719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.926954] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.927098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.927175] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a is going to be created. [ 734.931115] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.931241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.931324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.931495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.931577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.931735] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 734.950303] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.962357] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.962551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.962605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.962811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.962941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.977379] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a in Status: UNINITIALIZED for 2s [ 734.981971] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.982130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.982207] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.982410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.982551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.990416] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 735.132606] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e88ca4b-470a-485c-b906-6c8d635109cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.206019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.206019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.206019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.206019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.206019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.206019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.206019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.206019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.206019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.206019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.206019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.206019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.206019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.206019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.206019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.206019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.206612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.206612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.206612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.206612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.206612] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aaac1254-fb03-45ff-9ca3-f0edf21f5dad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.317585] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 18s [ 735.458034] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.458034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.458034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.458034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.458034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.458034] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 735.487287] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.487287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.487287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.487287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.487287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.493617] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 735.634497] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.634649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.634716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.634925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.635020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.635119] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e88ca4b-470a-485c-b906-6c8d635109cb is going to be created. [ 735.656449] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.656618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.656687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.656854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.657018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.666207] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e88ca4b-470a-485c-b906-6c8d635109cb in Status: UNINITIALIZED for 2s [ 735.709840] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aaac1254-fb03-45ff-9ca3-f0edf21f5dad: rpc.has_security_group_logging(os_id): False [ 735.732758] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.732925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.733114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.733219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.733341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.733557] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.733659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.733722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.733877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.733962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.734185] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.734313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.734414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.734528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.734594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.734810] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.734936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.735016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.735240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.735360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.735453] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad is going to be created. [ 735.803394] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.803557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.803624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.803826] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.803993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.814658] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad in Status: IN_PROGRESS for 2s [ 736.648112] env[68109]: INFO networking_nsxv3.common.synchronization [req-1a8a9e10-e195-49b5-8c54-3357a2703ff3 req-0345badd-ac8c-4e1d-b736-3daaa42c19f9 tempest-ServerAddressesTestJSON-1826698630 tempest-ServerAddressesTestJSON-1826698630-project-member] Enqueued Resource ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 with Priority: HIGHEST for action security_group_members [ 736.648112] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 with Priority: HIGHEST for action security_group_members [ 736.648112] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.648112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.648619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.648971] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.649473] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.649767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.649932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.650230] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.650402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.650583] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c7bce9f-4d75-4868-81b4-a0c0e5e4f420',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.929534] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-52 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.929717] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.929851] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.930201] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.930542] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.930636] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.930746] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.930967] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.931183] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.931423] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.931558] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.931694] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.931849] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.931977] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 736.932108] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.932244] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.948703] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.948871] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 736.949080] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.949275] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.949634] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-1bec436f-09ed-4811-9e7a-5fc07af482a1 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.949834] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-1bec436f-09ed-4811-9e7a-5fc07af482a1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.949942] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-1bec436f-09ed-4811-9e7a-5fc07af482a1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.950273] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-1bec436f-09ed-4811-9e7a-5fc07af482a1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.950414] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bec436f-09ed-4811-9e7a-5fc07af482a1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.987856] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a in Status: SUCCESS [ 736.988104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.988264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.988478] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.988660] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.988775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.988837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.989053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.989146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.989452] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.997920] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 736.998141] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.998590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.998777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.998947] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.999069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.999133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.999484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.999603] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.999704] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.152462] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.153097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.153097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.153097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.153097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.153251] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.153393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.153393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.153549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.153620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.153699] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 already deleted. [ 737.153774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.329112] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 20s [ 737.452387] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.452645] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.452777] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.453094] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.453255] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.453559] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 1bec436f-09ed-4811-9e7a-5fc07af482a1 not found, creating... [ 737.453665] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.453813] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.453926] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.454208] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.454357] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.454661] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.454813] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.454926] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.455144] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.455276] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.455416] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 1bec436f-09ed-4811-9e7a-5fc07af482a1 is going to be created. [ 737.476019] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.476262] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.476387] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.476696] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.476949] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.477191] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-1bec436f-09ed-4811-9e7a-5fc07af482a1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.490944] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.502779] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 737.502779] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.503047] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.504046] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.504380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.504584] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.504707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.504773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.504932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.505077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.505201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.505322] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.675315] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e88ca4b-470a-485c-b906-6c8d635109cb in Status: SUCCESS [ 737.675600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.675753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.675986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.676202] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.676345] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.676412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.676578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.676660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.676753] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e88ca4b-470a-485c-b906-6c8d635109cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.834770] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad in Status: SUCCESS [ 737.835064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.993670] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.007312] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.008510] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.008647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.008691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.008891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.009065] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.009163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.009222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.009374] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.009473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.009552] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.009673] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.009756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.009811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.009938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.010083] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.010165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.010237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.010378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.010447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.010523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.010604] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.179664] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e88ca4b-470a-485c-b906-6c8d635109cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.244458] env[68109]: INFO networking_nsxv3.common.synchronization [req-1a8a9e10-e195-49b5-8c54-3357a2703ff3 req-5465afd1-7254-40f3-b2e4-ff378e524214 service nova] Enqueued Resource ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 with Priority: HIGHEST for action security_group_rules [ 738.244458] env[68109]: INFO networking_nsxv3.common.synchronization [req-1a8a9e10-e195-49b5-8c54-3357a2703ff3 req-5465afd1-7254-40f3-b2e4-ff378e524214 service nova] Enqueued Resource ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 with Priority: HIGHEST for action security_group_members [ 738.244458] env[68109]: INFO networking_nsxv3.common.synchronization [req-1a8a9e10-e195-49b5-8c54-3357a2703ff3 req-5465afd1-7254-40f3-b2e4-ff378e524214 service nova] Enqueued Resource ID: 1bec436f-09ed-4811-9e7a-5fc07af482a1 with Priority: HIGHEST for action port [ 738.244458] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 with Priority: HIGHEST for action security_group_rules [ 738.244458] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 with Priority: HIGHEST for action security_group_members [ 738.244458] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bec436f-09ed-4811-9e7a-5fc07af482a1 with Priority: HIGHEST for action port [ 738.245240] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.245536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.245839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.246456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.246670] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c7bce9f-4d75-4868-81b4-a0c0e5e4f420',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.249068] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.249068] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.249068] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.249068] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.249068] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.249068] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.249068] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.249068] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.249068] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.249068] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c7bce9f-4d75-4868-81b4-a0c0e5e4f420',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.253150] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bec436f-09ed-4811-9e7a-5fc07af482a1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.253150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bec436f-09ed-4811-9e7a-5fc07af482a1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.253150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bec436f-09ed-4811-9e7a-5fc07af482a1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.253150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bec436f-09ed-4811-9e7a-5fc07af482a1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.253150] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bec436f-09ed-4811-9e7a-5fc07af482a1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.496078] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.496255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.496406] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.496564] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.496657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.496776] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a is going to be updated. [ 738.508819] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.508957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.509059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.509255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.509343] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.509467] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 738.514371] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7eff74c-b690-47ef-ba84-9ec9d2765c99: rpc.has_security_group_logging(os_id): False [ 738.524427] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.524583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.524653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.524838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.524983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.531365] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a in Status: IN_PROGRESS for 2s [ 738.535855] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.535964] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.536065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.536228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.536313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.536486] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.536581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.536649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.536779] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.536853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.537056] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.537140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.537219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.537339] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.537423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.537609] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.537793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.537793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.537887] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.537959] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.538054] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 738.539813] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.539930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.539981] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.540183] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.540275] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.547522] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 738.595424] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.595553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.595590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.595803] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.595946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.609314] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 738.680847] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e88ca4b-470a-485c-b906-6c8d635109cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.754395] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c7bce9f-4d75-4868-81b4-a0c0e5e4f420',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.755463] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.755569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.755733] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1bec436f-09ed-4811-9e7a-5fc07af482a1 with status ACTIVE [ 738.755889] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.756007] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.756075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.756271] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.756357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.756519] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.756611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.756672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.756820] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.756897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.757085] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.757177] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.757236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.757372] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.757444] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.757525] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1bec436f-09ed-4811-9e7a-5fc07af482a1 is going to be updated. [ 738.763703] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c7bce9f-4d75-4868-81b4-a0c0e5e4f420',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.785080] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.785299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.785299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.785475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.785612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.785770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bec436f-09ed-4811-9e7a-5fc07af482a1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.185132] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.185132] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.185132] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.185132] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.185132] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.185132] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e88ca4b-470a-485c-b906-6c8d635109cb is going to be updated. [ 739.211110] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.211110] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.211110] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.211110] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.211110] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.217471] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e88ca4b-470a-485c-b906-6c8d635109cb in Status: IN_PROGRESS for 2s [ 739.267160] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.267160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.267160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.267160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.267160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.267462] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 is going to be created. [ 739.290714] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.290867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.290939] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.291194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.291359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.303133] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 in Status: UNINITIALIZED for 2s [ 739.340509] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 22s [ 740.543150] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a in Status: SUCCESS [ 740.543150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.543150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.543539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.543539] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.543539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.543651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.543742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.543929] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.543929] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.544033] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.545495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.545719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.545893] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.545997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.546074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.546515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.546515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.546515] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.554778] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 740.556579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.556579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.556579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.556579] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.556579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.556579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.556579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.556579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.556579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.556579] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.557286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.557498] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.558191] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.558191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.558191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.558191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.558191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.558191] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.621565] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 740.621795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.048046] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.049076] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.060624] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.060817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.061073] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.226702] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e88ca4b-470a-485c-b906-6c8d635109cb in Status: SUCCESS [ 741.226908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.227058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.227306] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.227498] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.227608] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.227692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.227884] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.227968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.228060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.228152] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e88ca4b-470a-485c-b906-6c8d635109cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.312771] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 in Status: SUCCESS [ 741.313152] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.313408] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.313718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.314040] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.314225] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.314340] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.314595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.314732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.314879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.315087] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c7bce9f-4d75-4868-81b4-a0c0e5e4f420',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.351581] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 24s [ 741.550493] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04d6d7e9-ac4d-4788-ab37-9ef94a13367a: rpc.has_security_group_logging(os_id): False [ 741.551660] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.565413] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.580916] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.581066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.581134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.581477] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.582248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.582248] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.582248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.582248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.582447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.582447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.582499] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a is going to be created. [ 741.644018] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.647895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.647970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.648218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.648406] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.661534] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a in Status: IN_PROGRESS for 2s [ 741.670037] env[68109]: INFO networking_nsxv3.common.synchronization [req-7ebb1672-2ce9-4e0a-9915-774648d025be req-e9739e84-d284-4bf1-96e6-89af2a771196 tempest-FloatingIPsAssociationTestJSON-1926415346 tempest-FloatingIPsAssociationTestJSON-1926415346-project-member] Enqueued Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_members [ 741.670560] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGHEST for action security_group_members [ 741.670856] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.670978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.671478] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.671817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.671988] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.672121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.672200] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.672397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.672481] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.672572] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.682548] env[68109]: INFO networking_nsxv3.common.synchronization [req-de76ac55-77ce-4f5c-aa3b-f99b1c594c39 req-353d8d27-8c8f-4af6-933d-f0af3452cf84 tempest-ListServersNegativeTestJSON-1715359508 tempest-ListServersNegativeTestJSON-1715359508-project-member] Enqueued Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 741.683480] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 741.683775] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.683898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.683962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.684255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.684413] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.684516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.684607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.684722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.684804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.684897] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.731106] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e88ca4b-470a-485c-b906-6c8d635109cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.817312] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.817515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.817583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.817801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.817994] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.818141] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.818224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.818823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.818823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.818823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.818823] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.819084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.819084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.819172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.819283] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.819365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.819415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.819517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.819594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.819682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.819774] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c7bce9f-4d75-4868-81b4-a0c0e5e4f420',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.058493] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.058814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.058962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.059665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.059837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.059997] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a is going to be updated. [ 742.068037] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.068262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.068312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.069405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.069405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.069405] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 742.100710] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.101035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.101978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.101978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.101978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.105081] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.105232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.105376] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.105610] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.105766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.117488] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a in Status: IN_PROGRESS for 2s [ 742.118352] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 742.149153] env[68109]: INFO networking_nsxv3.common.synchronization [req-7bbe2560-2edb-4470-9c5f-aad0c8edacdb req-fe015f40-b5da-47e5-aa50-7b846a48cc09 tempest-ServerMetadataNegativeTestJSON-1194638423 tempest-ServerMetadataNegativeTestJSON-1194638423-project-member] Enqueued Resource ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 with Priority: HIGHEST for action security_group_members [ 742.151522] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 with Priority: HIGHEST for action security_group_members [ 742.154578] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-37f5dbb0-40eb-4b23-be82-699bd65bcb79 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.154578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.154578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.154578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.154578] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.154578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.154578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.154578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.154578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.154578] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37f5dbb0-40eb-4b23-be82-699bd65bcb79',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.179434] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.179434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.179598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.180123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.180123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.180123] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.180259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.180288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.180512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.180577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.180870] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 is going to be updated. [ 742.187387] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.187549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.187585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.187796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.187915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.188193] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.188584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.188584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.189738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.189738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.189738] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 already deleted. [ 742.189738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.223682] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.223823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.223891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.224162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.224320] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.234451] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e88ca4b-470a-485c-b906-6c8d635109cb: rpc.has_security_group_logging(os_id): False [ 742.238259] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 in Status: IN_PROGRESS for 2s [ 742.253714] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.253868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.253940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.254268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.254417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.254619] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.254714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.254777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.254944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.255560] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.255560] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e88ca4b-470a-485c-b906-6c8d635109cb is going to be created. [ 742.314631] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.314802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.314883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.315152] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.315364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.324021] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420: rpc.has_security_group_logging(os_id): False [ 742.327154] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e88ca4b-470a-485c-b906-6c8d635109cb in Status: IN_PROGRESS for 2s [ 742.354247] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.354247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.354247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.354247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.354247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.354247] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.354247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.354247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.354514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.354514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.354643] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.354735] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.354794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.354932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.355014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.355201] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.355314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.355375] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.355536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.355612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.355699] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 is going to be created. [ 742.406855] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-919 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.407070] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-919" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.407194] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-919" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.408931] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-919" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.408931] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.408931] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.408931] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.408931] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.408931] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.409350] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.409523] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.409692] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.409831] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.410019] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.410146] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.410442] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.433148] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.433148] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 742.433148] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.433148] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-919" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.433148] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-3b3dc194-7437-4247-9d94-328675f7be40 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.433148] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-3b3dc194-7437-4247-9d94-328675f7be40" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.433148] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-3b3dc194-7437-4247-9d94-328675f7be40" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.433148] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-3b3dc194-7437-4247-9d94-328675f7be40" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.433148] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b3dc194-7437-4247-9d94-328675f7be40',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.438205] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.438436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.438489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.438712] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.438892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.449727] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 in Status: IN_PROGRESS for 2s [ 742.661352] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.661352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.661352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.661352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.661352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.661352] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.661352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.661352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.661352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.661352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.661352] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 is going to be updated. [ 742.696181] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.696328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.696399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.696619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.696759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.712048] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 in Status: IN_PROGRESS for 2s [ 742.936285] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.936558] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.936681] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.936971] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.937140] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.937300] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 3b3dc194-7437-4247-9d94-328675f7be40 not found, creating... [ 742.937561] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.937716] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.937833] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.938061] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.938200] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.938467] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.938618] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.938734] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.938936] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.939086] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.939228] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 3b3dc194-7437-4247-9d94-328675f7be40 is going to be created. [ 742.956982] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.957237] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.957298] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.957616] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.957852] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.958082] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-3b3dc194-7437-4247-9d94-328675f7be40" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.362649] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 26s [ 743.399720] env[68109]: INFO networking_nsxv3.common.synchronization [None req-4c47ff40-8b6e-41a7-bb1c-a43c9af8291e tempest-ServerRescueNegativeTestJSON-575486598 tempest-ServerRescueNegativeTestJSON-575486598-project-member] Enqueued Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGHEST for action security_group_rules [ 743.400361] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGHEST for action security_group_rules [ 743.400764] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-747242aa-4753-441a-b06c-3f9a70ac6a6e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.400764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.401432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.401432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.401432] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('747242aa-4753-441a-b06c-3f9a70ac6a6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.477850] env[68109]: INFO networking_nsxv3.common.synchronization [None req-d9e21835-6877-4a95-aacd-9f1e77161d31 tempest-ServerRescueNegativeTestJSON-575486598 tempest-ServerRescueNegativeTestJSON-575486598-project-member] Enqueued Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGHEST for action security_group_rules [ 743.478610] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGHEST for action security_group_rules [ 743.478917] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-747242aa-4753-441a-b06c-3f9a70ac6a6e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.479029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.676100] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a in Status: SUCCESS [ 743.676100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.676100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.676100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.676100] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.888247] env[68109]: INFO networking_nsxv3.common.synchronization [req-de76ac55-77ce-4f5c-aa3b-f99b1c594c39 req-421357a2-2566-4141-b1a3-5f45e54d8777 service nova] Enqueued Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_rules [ 743.888421] env[68109]: INFO networking_nsxv3.common.synchronization [req-de76ac55-77ce-4f5c-aa3b-f99b1c594c39 req-421357a2-2566-4141-b1a3-5f45e54d8777 service nova] Enqueued Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 743.888561] env[68109]: INFO networking_nsxv3.common.synchronization [req-de76ac55-77ce-4f5c-aa3b-f99b1c594c39 req-421357a2-2566-4141-b1a3-5f45e54d8777 service nova] Enqueued Resource ID: 3b3dc194-7437-4247-9d94-328675f7be40 with Priority: HIGHEST for action port [ 743.888780] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_rules [ 743.888901] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 743.888997] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b3dc194-7437-4247-9d94-328675f7be40 with Priority: HIGHEST for action port [ 743.889880] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.890258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.890394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.890667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.890776] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.891607] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.891753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.891842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.892088] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.892256] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.892518] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.892621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.892783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.892915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.893081] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.894390] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b3dc194-7437-4247-9d94-328675f7be40 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.894735] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b3dc194-7437-4247-9d94-328675f7be40" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.894856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b3dc194-7437-4247-9d94-328675f7be40" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.895909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b3dc194-7437-4247-9d94-328675f7be40" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.895990] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b3dc194-7437-4247-9d94-328675f7be40',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.922062] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.922364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.922364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.922606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.922759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.922909] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e already deleted. [ 743.923074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.923379] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.923448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.923547] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('747242aa-4753-441a-b06c-3f9a70ac6a6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.984000] env[68109]: INFO networking_nsxv3.common.synchronization [req-3d7c990f-a801-47fa-ab3c-bb1c74631d3a req-743b16ed-ea21-43de-95d3-1dc63dc86f4d tempest-ServerAddressesNegativeTestJSON-1418903357 tempest-ServerAddressesNegativeTestJSON-1418903357-project-member] Enqueued Resource ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad with Priority: HIGHEST for action security_group_members [ 743.984496] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad with Priority: HIGHEST for action security_group_members [ 743.984795] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.984906] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.985044] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.985244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.985399] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.985501] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.985562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.985705] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.985790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.985881] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aaac1254-fb03-45ff-9ca3-f0edf21f5dad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.127629] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a in Status: SUCCESS [ 744.128078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.128400] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.128613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.128805] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.128919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.128992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.129164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.129247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.129342] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.130645] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 744.130819] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.131290] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.131413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.131566] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.131666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.131845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.131845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.131918] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.132051] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.178246] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.178426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.248699] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 in Status: SUCCESS [ 744.248885] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 deletion is rescheduled due to dependency. [ 744.249018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.265697] env[68109]: INFO networking_nsxv3.common.synchronization [req-de76ac55-77ce-4f5c-aa3b-f99b1c594c39 req-35b2b351-f3a7-4d0c-82b1-036796fc515b tempest-ListServersNegativeTestJSON-1715359508 tempest-ListServersNegativeTestJSON-1715359508-project-member] Enqueued Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 744.266626] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 744.266626] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.266626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.337723] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e88ca4b-470a-485c-b906-6c8d635109cb in Status: SUCCESS [ 744.337954] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.397946] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.398972] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.399085] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.403491] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b3dc194-7437-4247-9d94-328675f7be40 with status ACTIVE [ 744.403491] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.403491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.403491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.403491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.403491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.403491] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.403491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.403491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.403491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.403491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.403491] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.403491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.403491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.403491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.403491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.403491] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b3dc194-7437-4247-9d94-328675f7be40 is going to be updated. [ 744.422420] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.422645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.422758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.423062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.423248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.423439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b3dc194-7437-4247-9d94-328675f7be40" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.456634] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.457054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.457192] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.457514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.457651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.459145] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e already deleted. [ 744.459145] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.469232] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 in Status: SUCCESS [ 744.469427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.487994] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.488165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.488214] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.488456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.488557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.488786] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.488921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.489011] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.489448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.489448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.489448] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad is going to be updated. [ 744.516831] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.516993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.517056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.517252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.517387] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.526289] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad in Status: IN_PROGRESS for 2s [ 744.578261] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-919 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.578261] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-919" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.578261] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-919" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.578261] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-919" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.578261] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.578261] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.578261] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.578261] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.578261] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.578261] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 744.578261] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.578965] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.578965] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.578965] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 744.578965] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.578965] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.597754] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.597754] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 744.597957] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.598037] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-919" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.598317] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-6f867709-9f07-47df-89b3-6b5667a32405 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.598491] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-6f867709-9f07-47df-89b3-6b5667a32405" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.598611] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-6f867709-9f07-47df-89b3-6b5667a32405" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.598945] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-6f867709-9f07-47df-89b3-6b5667a32405" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.599138] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f867709-9f07-47df-89b3-6b5667a32405',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.633410] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.634598] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.721426] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 in Status: SUCCESS [ 744.721426] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 deletion is rescheduled due to dependency. [ 744.721426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.900907] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.102232] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.102513] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.102659] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.102981] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.103253] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.103416] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 6f867709-9f07-47df-89b3-6b5667a32405 not found, creating... [ 745.103687] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.103845] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.103962] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.104257] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.104418] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.104804] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.104976] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.105110] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.105324] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.105461] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.105603] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 6f867709-9f07-47df-89b3-6b5667a32405 is going to be created. [ 745.123898] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.123898] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.124091] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.124352] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.124578] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.126972] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-6f867709-9f07-47df-89b3-6b5667a32405" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.137580] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.138491] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.375252] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 28s [ 745.402825] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.403028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.403205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.403442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.403536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.403639] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 is going to be created. [ 745.425438] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.425616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.425654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.425859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.426054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.434934] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: UNINITIALIZED for 2s [ 745.641059] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.641244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.641322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.641598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.641654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.641821] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a is going to be updated. [ 745.643336] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.643465] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.643534] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.644099] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.644099] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.644099] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 745.672588] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.672785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.672860] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.673096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.673259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.674917] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.675108] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.675188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.675357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.676054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.685485] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a in Status: IN_PROGRESS for 2s [ 745.686121] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 745.814210] env[68109]: INFO networking_nsxv3.common.synchronization [req-de76ac55-77ce-4f5c-aa3b-f99b1c594c39 req-a8dfcc69-9349-4cf3-b8ed-4c53a8f11889 service nova] Enqueued Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_rules [ 745.814210] env[68109]: INFO networking_nsxv3.common.synchronization [req-de76ac55-77ce-4f5c-aa3b-f99b1c594c39 req-a8dfcc69-9349-4cf3-b8ed-4c53a8f11889 service nova] Enqueued Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 745.814210] env[68109]: INFO networking_nsxv3.common.synchronization [req-de76ac55-77ce-4f5c-aa3b-f99b1c594c39 req-a8dfcc69-9349-4cf3-b8ed-4c53a8f11889 service nova] Enqueued Resource ID: 6f867709-9f07-47df-89b3-6b5667a32405 with Priority: HIGHEST for action port [ 745.814210] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_rules [ 745.814210] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 745.814210] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f867709-9f07-47df-89b3-6b5667a32405 with Priority: HIGHEST for action port [ 745.814210] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.814210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.814210] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.814210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.815229] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f867709-9f07-47df-89b3-6b5667a32405 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.816554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f867709-9f07-47df-89b3-6b5667a32405" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.816554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f867709-9f07-47df-89b3-6b5667a32405" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.816554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f867709-9f07-47df-89b3-6b5667a32405" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.816554] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f867709-9f07-47df-89b3-6b5667a32405',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.318477] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6f867709-9f07-47df-89b3-6b5667a32405 with status ACTIVE [ 746.318858] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.319091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.319204] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.319556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.319726] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.319839] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.319947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.320022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.320233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.320327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.320521] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.320621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.320677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.320834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.320909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.321130] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6f867709-9f07-47df-89b3-6b5667a32405 is going to be updated. [ 746.340951] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.341716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.341716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.341716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.341716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.341716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f867709-9f07-47df-89b3-6b5667a32405" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.536513] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad in Status: SUCCESS [ 746.536706] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad deletion is rescheduled due to dependency. [ 746.536801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.911915] env[68109]: INFO networking_nsxv3.common.synchronization [req-de76ac55-77ce-4f5c-aa3b-f99b1c594c39 req-239e30e5-3f3b-482e-8bf9-cf64a28d2712 tempest-ListServersNegativeTestJSON-1715359508 tempest-ListServersNegativeTestJSON-1715359508-project-member] Enqueued Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 746.915588] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 746.916020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.916203] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.198707] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-919 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.198914] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-919" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.199055] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-919" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.199432] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-919" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.199730] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.199888] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.200009] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.200242] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.201244] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.201244] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.201244] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.201244] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.201244] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.201244] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 747.201244] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.201244] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.227874] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.228070] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 747.228242] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.228438] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-919" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.228963] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-c84603fc-e755-4502-adc7-d9d8c6fb50d9 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.229095] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-c84603fc-e755-4502-adc7-d9d8c6fb50d9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.229144] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-c84603fc-e755-4502-adc7-d9d8c6fb50d9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.229461] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-c84603fc-e755-4502-adc7-d9d8c6fb50d9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.229682] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c84603fc-e755-4502-adc7-d9d8c6fb50d9',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.386446] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 30s [ 747.450466] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: SUCCESS [ 747.450747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.450955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.451248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.451466] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.451616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.451701] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.451983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.452126] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.452245] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.696281] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 747.696559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.696718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.697257] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.697257] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.697423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.697423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.697591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.697682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.697731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.697883] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.697980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.698233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.698500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.698650] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.698745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.698806] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.698942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.699114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.699264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.699363] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.700767] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a in Status: SUCCESS [ 747.700936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.701093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.701253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.701671] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.701854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.701903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.702035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.702197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.702197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.702264] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.732141] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.732141] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.732141] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.732428] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.732576] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.732745] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port c84603fc-e755-4502-adc7-d9d8c6fb50d9 not found, creating... [ 747.733105] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.733266] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.733428] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.735087] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.735087] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.735087] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.735087] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.735087] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.735087] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.735087] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.735087] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: c84603fc-e755-4502-adc7-d9d8c6fb50d9 is going to be created. [ 747.753943] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.754186] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.754331] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.754619] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.754905] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.755156] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-c84603fc-e755-4502-adc7-d9d8c6fb50d9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.955641] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.203889] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a8ad551-9243-4b5e-a0bd-acf823c5b01f: rpc.has_security_group_logging(os_id): False [ 748.205653] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.226685] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.228369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.228369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.228369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.228369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.228369] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.228369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.228369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.228369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.228613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.228613] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.228813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.228813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.228920] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.229016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.229196] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.229305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.229357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.229476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.229571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.229659] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 748.285617] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.285765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.285838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.286060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.286206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.300239] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 748.458323] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.481189] env[68109]: INFO networking_nsxv3.common.synchronization [req-de76ac55-77ce-4f5c-aa3b-f99b1c594c39 req-48e3494a-4129-47d9-9849-d419768ff10e service nova] Enqueued Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_rules [ 748.481370] env[68109]: INFO networking_nsxv3.common.synchronization [req-de76ac55-77ce-4f5c-aa3b-f99b1c594c39 req-48e3494a-4129-47d9-9849-d419768ff10e service nova] Enqueued Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 748.481510] env[68109]: INFO networking_nsxv3.common.synchronization [req-de76ac55-77ce-4f5c-aa3b-f99b1c594c39 req-48e3494a-4129-47d9-9849-d419768ff10e service nova] Enqueued Resource ID: c84603fc-e755-4502-adc7-d9d8c6fb50d9 with Priority: HIGHEST for action port [ 748.481964] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_rules [ 748.482200] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 748.482200] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c84603fc-e755-4502-adc7-d9d8c6fb50d9 with Priority: HIGHEST for action port [ 748.482462] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.482579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.482841] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.483136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.483686] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-c84603fc-e755-4502-adc7-d9d8c6fb50d9 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.483686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c84603fc-e755-4502-adc7-d9d8c6fb50d9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.483686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c84603fc-e755-4502-adc7-d9d8c6fb50d9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.483686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c84603fc-e755-4502-adc7-d9d8c6fb50d9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.483985] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c84603fc-e755-4502-adc7-d9d8c6fb50d9',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.708455] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04d6d7e9-ac4d-4788-ab37-9ef94a13367a: rpc.has_security_group_logging(os_id): False [ 748.725160] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.725324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.725387] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.725769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.725870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.726110] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.726217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.726318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.726428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.726505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.726590] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a is going to be updated. [ 748.779627] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.779627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.779627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.779627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.779892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.793905] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a in Status: IN_PROGRESS for 2s [ 748.961710] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.962010] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.962010] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.962210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.962309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.962409] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 is going to be updated. [ 748.985980] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c84603fc-e755-4502-adc7-d9d8c6fb50d9 with status ACTIVE [ 748.986211] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.986351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.986417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.986622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.986713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.986896] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.986971] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.987049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.987179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.987259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.988209] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.988209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.988209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.988209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.988209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.988209] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c84603fc-e755-4502-adc7-d9d8c6fb50d9 is going to be updated. [ 748.989843] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.989953] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.990030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.990194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.990321] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.003315] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: IN_PROGRESS for 2s [ 749.010854] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.010977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.011090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.011255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.011387] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.011545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c84603fc-e755-4502-adc7-d9d8c6fb50d9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.398242] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 32s [ 749.650021] env[68109]: INFO networking_nsxv3.common.synchronization [req-faf3e458-c558-4982-a33b-7e9c96f327c3 req-4076a03a-8a3f-40aa-8bd3-53e589634917 tempest-ImagesTestJSON-447768907 tempest-ImagesTestJSON-447768907-project-member] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 749.650021] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 749.650021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.650021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.650021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.650759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.651097] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.651341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.652762] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.652762] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.652762] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.652762] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.940304] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.941030] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.941030] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.941030] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.941258] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.941395] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.941513] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.941727] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.941871] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.942096] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.942211] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.942321] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.942441] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.942576] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.942688] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.942821] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.976088] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.976385] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 749.976496] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.976691] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.977180] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-dedb73ff-3dc9-437e-965c-7a6bb74a5621 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.977357] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-dedb73ff-3dc9-437e-965c-7a6bb74a5621" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.977508] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-dedb73ff-3dc9-437e-965c-7a6bb74a5621" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.977856] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-dedb73ff-3dc9-437e-965c-7a6bb74a5621" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.978071] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dedb73ff-3dc9-437e-965c-7a6bb74a5621',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.154332] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.154568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.154668] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.154894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.154986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.155198] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.155297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.155408] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.155518] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.155593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.155676] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 already deleted. [ 750.155755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.316043] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 750.316284] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.320217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.320217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.320217] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.481073] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.481073] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.481305] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.481609] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.481767] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.481926] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port dedb73ff-3dc9-437e-965c-7a6bb74a5621 not found, creating... [ 750.482229] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.482394] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.482510] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.482726] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.482866] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.483288] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.483514] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.483639] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.483863] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.484016] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.484262] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: dedb73ff-3dc9-437e-965c-7a6bb74a5621 is going to be created. [ 750.504341] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.504528] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.504691] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.504933] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.505184] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.505428] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-dedb73ff-3dc9-437e-965c-7a6bb74a5621" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.807585] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a in Status: SUCCESS [ 750.808087] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.821822] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.821996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.822057] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.824377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.824377] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.824377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.824377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.824377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.824377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.824377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.824377] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.013419] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: SUCCESS [ 751.013689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.013793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.014023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.014218] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.014333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.014395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.014553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.014630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.014719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.014825] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.022713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.023021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.023230] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.023354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.023417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.023571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.023653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.025020] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.233468] env[68109]: INFO networking_nsxv3.common.synchronization [req-d4488eab-ff88-4735-8a48-880b2bb4d661 req-c5d6f171-b1d9-4a95-bb44-b696d0cee35d tempest-ServerAddressesTestJSON-1826698630 tempest-ServerAddressesTestJSON-1826698630-project-member] Enqueued Resource ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 with Priority: HIGHEST for action security_group_members [ 751.234102] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 with Priority: HIGHEST for action security_group_members [ 751.234469] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.234663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.234763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.235082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.238857] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.238857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.238857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.238857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.238857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.238857] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c7bce9f-4d75-4868-81b4-a0c0e5e4f420',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.263802] env[68109]: INFO networking_nsxv3.common.synchronization [req-faf3e458-c558-4982-a33b-7e9c96f327c3 req-81469a74-0716-465e-b675-18d058183234 service nova] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_rules [ 751.263802] env[68109]: INFO networking_nsxv3.common.synchronization [req-faf3e458-c558-4982-a33b-7e9c96f327c3 req-81469a74-0716-465e-b675-18d058183234 service nova] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 751.263802] env[68109]: INFO networking_nsxv3.common.synchronization [req-faf3e458-c558-4982-a33b-7e9c96f327c3 req-81469a74-0716-465e-b675-18d058183234 service nova] Enqueued Resource ID: dedb73ff-3dc9-437e-965c-7a6bb74a5621 with Priority: HIGHEST for action port [ 751.263802] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_rules [ 751.263802] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 751.263802] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dedb73ff-3dc9-437e-965c-7a6bb74a5621 with Priority: HIGHEST for action port [ 751.263802] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.263802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.263802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.263802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.263802] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.263802] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.263802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.264359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.264359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.264359] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.264359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.264359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.264602] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.264602] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.264701] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.265372] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-dedb73ff-3dc9-437e-965c-7a6bb74a5621 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.265632] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dedb73ff-3dc9-437e-965c-7a6bb74a5621" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.265632] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dedb73ff-3dc9-437e-965c-7a6bb74a5621" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.265798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dedb73ff-3dc9-437e-965c-7a6bb74a5621" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.267430] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dedb73ff-3dc9-437e-965c-7a6bb74a5621',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.325204] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.325357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.325429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.325682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.325895] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.326015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.326075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.326234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.326319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.326406] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.326553] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.326658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.326725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.326852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.326984] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.327115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.327184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.328371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.328371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.328371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.328371] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.410134] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 34s [ 751.524833] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.524989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.526679] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.742249] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.742410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.742482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.742710] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.742795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.742990] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.743132] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.743203] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.743361] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.743441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.743527] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 is going to be updated. [ 751.767035] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.768039] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.768150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.770333] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.770483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.770533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.770725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.770871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.772299] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dedb73ff-3dc9-437e-965c-7a6bb74a5621 with status ACTIVE [ 751.772484] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.772928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.772928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.772928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.773158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.773196] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.773313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.773398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.773567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.773665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.773870] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.773965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.774103] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.774200] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.774311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.774462] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dedb73ff-3dc9-437e-965c-7a6bb74a5621 is going to be updated. [ 751.785222] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 in Status: IN_PROGRESS for 2s [ 751.795871] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.796045] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.796109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.796322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.796468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.796658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dedb73ff-3dc9-437e-965c-7a6bb74a5621" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.829857] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a8ad551-9243-4b5e-a0bd-acf823c5b01f: rpc.has_security_group_logging(os_id): False [ 751.847895] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.847895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.847895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.847895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.848160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.848189] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.848327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.848372] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.848541] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.848635] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.848833] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.848932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.848994] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.849168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.849258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.849434] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.849528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.849588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.849724] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.849821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.849909] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 751.924392] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.924557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.924623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.924846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.925009] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.952674] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 752.028958] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.269403] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.532532] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.532725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.532797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.533017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.533171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.533276] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 is going to be updated. [ 752.559338] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.559476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.559545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.559734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.559874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.568041] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: IN_PROGRESS for 2s [ 752.772823] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.773020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.773156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.773391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.773484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.773620] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be created. [ 752.797835] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.798052] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.798180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.798432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.798647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.806819] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: UNINITIALIZED for 2s [ 753.422269] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 36s [ 753.795304] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 in Status: SUCCESS [ 753.795482] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 deletion is rescheduled due to dependency. [ 753.795595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.974510] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 753.974734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.577415] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: SUCCESS [ 754.577704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.578125] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.578345] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.578528] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.578641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.578702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.578976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.579074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.579190] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.816756] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 754.816980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.817242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.817471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.817663] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.817780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.817838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.818043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.818092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.818168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.818259] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.082096] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.321056] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.321284] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.321284] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.321506] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.321682] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.321812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.321877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.322069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.322153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.322247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.322430] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.322527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.322583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.322783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.322930] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.323065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.323173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.323383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.323447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.323549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.323644] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.436905] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 38s [ 755.584776] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.826437] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bd26aad-19e8-435d-b39a-5875f3b5cfd7: rpc.has_security_group_logging(os_id): False [ 755.845609] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.845768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.845942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.846092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.846147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.846346] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.846452] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.846515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.846673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.846746] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.847058] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.847058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.847058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.847235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.847330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.847450] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.847539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.847603] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.847727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.847798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.847929] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be created. [ 755.907136] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.907321] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.907401] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.907685] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.907875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.921691] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 756.087845] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.088032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.088032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.088758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.088758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.088758] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 is going to be updated. [ 756.113939] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.113939] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.113939] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.114175] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.114247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.122422] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: IN_PROGRESS for 2s [ 756.262395] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 756.262553] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=7 [ 756.286743] env[68109]: INFO networking_nsxv3.common.synchronization [req-fe34a20d-363f-462a-9967-358d737bfe85 req-0b11c106-c9f5-4113-a1b8-4e6171120529 tempest-ServerDiskConfigTestJSON-1064584538 tempest-ServerDiskConfigTestJSON-1064584538-project-member] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 756.286743] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 756.286743] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.286743] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.286743] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.287303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.287303] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.287303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.287303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.287538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.287538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.287538] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.793552] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.793856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.793856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.794019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.794120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.794396] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.794510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.794569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.794719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.794791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.794877] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 756.821236] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.821681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.821681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.821794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.823323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.832649] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 757.448541] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 40s [ 757.935057] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 757.935297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.131505] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: SUCCESS [ 758.131683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.131854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.132157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.132349] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.132476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.132543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.132804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.132879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.132938] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.635334] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.842948] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 758.843217] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 deletion is rescheduled due to dependency. [ 758.843348] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.137968] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.461374] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 42s [ 759.640368] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.640531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.640607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.640825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.640920] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.641088] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 is going to be updated. [ 759.668445] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.668629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.668673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.668853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.669014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.682113] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: IN_PROGRESS for 2s [ 761.288558] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 761.288796] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 761.390247] env[68109]: INFO networking_nsxv3.common.synchronization [req-3e3876b8-5b48-40cd-94a9-964b67f0c72f req-dfccbe7d-c12b-481d-b213-de6aadf1451e tempest-AttachInterfacesV270Test-1687339747 tempest-AttachInterfacesV270Test-1687339747-project-member] Enqueued Resource ID: 835f674b-2b51-49ea-acd5-6a176ad00616 with Priority: HIGHEST for action security_group_members [ 761.390797] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835f674b-2b51-49ea-acd5-6a176ad00616 with Priority: HIGHEST for action security_group_members [ 761.391166] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-835f674b-2b51-49ea-acd5-6a176ad00616 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.391298] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.391379] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.391640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.391808] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.391910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.391972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.392148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.392247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.392347] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('835f674b-2b51-49ea-acd5-6a176ad00616',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.475275] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 44s [ 761.692470] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-74 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.692669] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.692794] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.693143] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.693441] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.693601] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.693720] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.693941] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.694899] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.695192] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.695321] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.695434] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.695543] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.695654] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.695760] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.695888] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.697543] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: SUCCESS [ 761.697808] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.698245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.698424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.698601] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.698699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.698765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.698912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.698994] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.699094] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.699248] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.699343] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.699401] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.699546] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.699682] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.699773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.699832] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.699967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.700059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.700140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.700226] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.718971] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.719161] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 761.719306] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.719487] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.719806] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-d98b893a-b079-4b23-aa21-5e584db12cd4 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.719978] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-d98b893a-b079-4b23-aa21-5e584db12cd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.720122] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-d98b893a-b079-4b23-aa21-5e584db12cd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.720449] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-d98b893a-b079-4b23-aa21-5e584db12cd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.720611] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d98b893a-b079-4b23-aa21-5e584db12cd4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.895177] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.895397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.895471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.895751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.895921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.896234] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.896429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.896604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.896671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.896755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.896848] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 835f674b-2b51-49ea-acd5-6a176ad00616 already deleted. [ 761.896955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.985111] env[68109]: INFO networking_nsxv3.common.synchronization [req-281c837d-8af9-4988-8686-ff9f113a8c48 req-286f484d-9ae9-4cb7-8a23-c0ece1accef7 tempest-ListServersNegativeTestJSON-1715359508 tempest-ListServersNegativeTestJSON-1715359508-project-member] Enqueued Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 761.985675] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 761.986684] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.986684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.986684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.986684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.986684] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.986684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.986684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.987229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.987229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.987229] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.203473] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe094fad-6ec3-4179-88a0-da40e49c0ff5: rpc.has_security_group_logging(os_id): False [ 762.222175] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.222325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.222398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.222621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.222715] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.222906] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.223012] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.223080] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.223300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.223387] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.223586] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.223683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.223778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.223880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.223955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.224150] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.224320] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.224407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.224554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.224630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.224716] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 is going to be created. [ 762.226150] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.226333] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.226669] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.226920] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.227074] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.227655] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port d98b893a-b079-4b23-aa21-5e584db12cd4 not found, creating... [ 762.227655] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.227655] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.228057] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.228057] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.228057] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.228341] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.228756] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.228756] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.229045] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.229045] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.229045] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: d98b893a-b079-4b23-aa21-5e584db12cd4 is going to be created. [ 762.250432] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.251328] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.251328] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.251328] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.251328] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.251505] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-d98b893a-b079-4b23-aa21-5e584db12cd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.295662] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.296041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.296041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.296113] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.296287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.313588] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: IN_PROGRESS for 2s [ 762.497594] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.953266] env[68109]: INFO networking_nsxv3.common.synchronization [req-3e3876b8-5b48-40cd-94a9-964b67f0c72f req-71beb6f5-1b32-44bf-a8c1-59d953a93146 service nova] Enqueued Resource ID: 835f674b-2b51-49ea-acd5-6a176ad00616 with Priority: HIGHEST for action security_group_rules [ 762.953632] env[68109]: INFO networking_nsxv3.common.synchronization [req-3e3876b8-5b48-40cd-94a9-964b67f0c72f req-71beb6f5-1b32-44bf-a8c1-59d953a93146 service nova] Enqueued Resource ID: 835f674b-2b51-49ea-acd5-6a176ad00616 with Priority: HIGHEST for action security_group_members [ 762.953997] env[68109]: INFO networking_nsxv3.common.synchronization [req-3e3876b8-5b48-40cd-94a9-964b67f0c72f req-71beb6f5-1b32-44bf-a8c1-59d953a93146 service nova] Enqueued Resource ID: d98b893a-b079-4b23-aa21-5e584db12cd4 with Priority: HIGHEST for action port [ 762.955120] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835f674b-2b51-49ea-acd5-6a176ad00616 with Priority: HIGHEST for action security_group_rules [ 762.955120] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835f674b-2b51-49ea-acd5-6a176ad00616 with Priority: HIGHEST for action security_group_members [ 762.955120] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d98b893a-b079-4b23-aa21-5e584db12cd4 with Priority: HIGHEST for action port [ 762.955462] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-835f674b-2b51-49ea-acd5-6a176ad00616 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.955751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.955927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.956293] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.956528] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('835f674b-2b51-49ea-acd5-6a176ad00616',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.958385] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-835f674b-2b51-49ea-acd5-6a176ad00616 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.958638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.959458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.959458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.959458] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.959458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.959458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.959980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.960138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.960260] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('835f674b-2b51-49ea-acd5-6a176ad00616',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.961541] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-d98b893a-b079-4b23-aa21-5e584db12cd4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.961651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d98b893a-b079-4b23-aa21-5e584db12cd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.961728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d98b893a-b079-4b23-aa21-5e584db12cd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.961982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d98b893a-b079-4b23-aa21-5e584db12cd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.961982] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d98b893a-b079-4b23-aa21-5e584db12cd4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.001969] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.460248] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-835f674b-2b51-49ea-acd5-6a176ad00616 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.460606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.463808] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('835f674b-2b51-49ea-acd5-6a176ad00616',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.467046] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d98b893a-b079-4b23-aa21-5e584db12cd4 with status ACTIVE [ 763.467046] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.467196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.467196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.468086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.468086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.468086] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.468086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.468086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.468086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.468086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.468365] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.468365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.468365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.468464] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.468535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.468584] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d98b893a-b079-4b23-aa21-5e584db12cd4 is going to be updated. [ 763.484980] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 46s [ 763.488743] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.488885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.488942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.489506] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.489506] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.489506] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d98b893a-b079-4b23-aa21-5e584db12cd4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.505987] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.505987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.505987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.505987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.505987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.505987] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 is going to be updated. [ 763.534211] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.534585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.534665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.534879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.535028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.553523] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: IN_PROGRESS for 2s [ 763.584637] env[68109]: INFO networking_nsxv3.common.synchronization [req-0cfc2891-3406-4613-b0bc-da2b4b055fbc req-0cac4d3c-c980-4de8-836c-e0edaed893f8 tempest-ServersAdminNegativeTestJSON-2123175983 tempest-ServersAdminNegativeTestJSON-2123175983-project-member] Enqueued Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_members [ 763.585220] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGHEST for action security_group_members [ 763.585614] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.585747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.585814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.586092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.586285] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.586418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.586511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.586702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.586823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.586952] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.971455] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('835f674b-2b51-49ea-acd5-6a176ad00616',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.082297] env[68109]: INFO networking_nsxv3.common.synchronization [req-b5826753-83de-4947-a450-677495b83683 req-59aaa0a0-24c2-4752-bc18-51c6a58d3fb6 tempest-ServersTestBootFromVolume-1173265696 tempest-ServersTestBootFromVolume-1173265696-project-member] Enqueued Resource ID: 817904c7-035a-41ce-bf21-c0db158c7bea with Priority: HIGHEST for action security_group_members [ 764.082297] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 817904c7-035a-41ce-bf21-c0db158c7bea with Priority: HIGHEST for action security_group_members [ 764.082297] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-817904c7-035a-41ce-bf21-c0db158c7bea taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.082297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.082297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.084555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.084946] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.084946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.085139] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.085243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.085309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.085430] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('817904c7-035a-41ce-bf21-c0db158c7bea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.089204] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.089370] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.089426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.089790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.089790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.089902] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.089954] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.090062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.090204] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.090328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.090397] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee121dc7-4686-4564-b58a-255456cf3857 is going to be updated. [ 764.115010] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.115176] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.115273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.115599] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.115790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.124027] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee121dc7-4686-4564-b58a-255456cf3857 in Status: IN_PROGRESS for 2s [ 764.324934] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: SUCCESS [ 764.324934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.324934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.324934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.324934] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.474384] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.474736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.474847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.475255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.475449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.475647] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 835f674b-2b51-49ea-acd5-6a176ad00616 is going to be created. [ 764.497755] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.499268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.499366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.499702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.501117] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.511628] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 835f674b-2b51-49ea-acd5-6a176ad00616 in Status: UNINITIALIZED for 2s [ 764.521508] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.521704] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-791" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.521829] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-791" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.522577] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-791" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.522577] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.522577] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.522710] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.522900] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.524338] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.524338] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.524338] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.524338] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.524338] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.524338] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.524338] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.524338] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.545427] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.545634] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 764.545734] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.545955] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-791" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.546389] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.546614] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.546795] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.547132] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.547399] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.588925] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.589020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.589121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.589341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.589411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.589732] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.589732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.589840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.589956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.590116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.590156] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 817904c7-035a-41ce-bf21-c0db158c7bea already deleted. [ 764.590211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.787768] env[68109]: INFO networking_nsxv3.common.synchronization [None req-ffac7775-41db-44b4-b4f6-0eb8b1849c25 None None] Enqueued Resource ID: f3a0a559-b885-434e-8cde-74db3ee18839 with Priority: HIGHEST for action port [ 764.790439] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3a0a559-b885-434e-8cde-74db3ee18839 with Priority: HIGHEST for action port [ 764.791057] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3a0a559-b885-434e-8cde-74db3ee18839 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.791057] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3a0a559-b885-434e-8cde-74db3ee18839" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.791874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3a0a559-b885-434e-8cde-74db3ee18839" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.792024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3a0a559-b885-434e-8cde-74db3ee18839" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.792116] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3a0a559-b885-434e-8cde-74db3ee18839',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.829757] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.829898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.051779] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.052070] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.052153] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.052651] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.052651] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.052854] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea not found, creating... [ 765.053130] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.053400] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.053576] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.053860] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.054390] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.054469] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.054588] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.054710] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.054949] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.057608] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.057608] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea is going to be created. [ 765.079372] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.079603] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.079603] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.083114] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.083114] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.083114] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.296159] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3a0a559-b885-434e-8cde-74db3ee18839 [ 765.297392] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.297392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.297392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.297392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.297392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.297392] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3a0a559-b885-434e-8cde-74db3ee18839 already deleted. [ 765.297392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3a0a559-b885-434e-8cde-74db3ee18839" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.497172] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 48s [ 765.562464] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: SUCCESS [ 765.562665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.562834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.563064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.565016] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.565016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.565016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.565016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.565016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.565016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.565016] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.801297] env[68109]: INFO networking_nsxv3.common.synchronization [req-b5826753-83de-4947-a450-677495b83683 req-0a1f3b85-acd4-4ee5-add0-42894e16b900 service nova] Enqueued Resource ID: 817904c7-035a-41ce-bf21-c0db158c7bea with Priority: HIGHEST for action security_group_rules [ 765.801483] env[68109]: INFO networking_nsxv3.common.synchronization [req-b5826753-83de-4947-a450-677495b83683 req-0a1f3b85-acd4-4ee5-add0-42894e16b900 service nova] Enqueued Resource ID: 817904c7-035a-41ce-bf21-c0db158c7bea with Priority: HIGHEST for action security_group_members [ 765.801696] env[68109]: INFO networking_nsxv3.common.synchronization [req-b5826753-83de-4947-a450-677495b83683 req-0a1f3b85-acd4-4ee5-add0-42894e16b900 service nova] Enqueued Resource ID: ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea with Priority: HIGHEST for action port [ 765.802229] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 817904c7-035a-41ce-bf21-c0db158c7bea with Priority: HIGHEST for action security_group_rules [ 765.802377] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 817904c7-035a-41ce-bf21-c0db158c7bea with Priority: HIGHEST for action security_group_members [ 765.802478] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea with Priority: HIGHEST for action port [ 765.802765] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-817904c7-035a-41ce-bf21-c0db158c7bea taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.802973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.805041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.805041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.805041] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('817904c7-035a-41ce-bf21-c0db158c7bea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.806115] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-817904c7-035a-41ce-bf21-c0db158c7bea taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.806220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.806292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.806500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.806687] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.806792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.806852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.807052] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.807136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.807266] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('817904c7-035a-41ce-bf21-c0db158c7bea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.813512] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.813742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.813818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.814116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.814239] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.068588] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.069864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.069864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.069864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.069864] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.069864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.069864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.069864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.069864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.069864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.070353] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.070515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.070581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.070757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.070941] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.071076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.071159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.071318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.071416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.071500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.071606] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.139305] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee121dc7-4686-4564-b58a-255456cf3857 in Status: SUCCESS [ 766.139305] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee121dc7-4686-4564-b58a-255456cf3857 deletion is rescheduled due to dependency. [ 766.139305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.316732] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-817904c7-035a-41ce-bf21-c0db158c7bea taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.316958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.317397] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('817904c7-035a-41ce-bf21-c0db158c7bea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.318398] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea with status ACTIVE [ 766.318645] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.318830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.318962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.319239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.319377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.319647] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.319794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.319885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.324518] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.324688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.325028] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.325196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.325291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.325539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.325655] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.325789] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea is going to be updated. [ 766.346413] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.346564] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.346631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.346847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.346985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.347164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee2ccf6a-33d8-481f-b1d6-f393cb9d15ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.520079] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 835f674b-2b51-49ea-acd5-6a176ad00616 in Status: SUCCESS [ 766.520079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.520079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.520079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.520841] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.520841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.520841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.520841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.520841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.520841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.520841] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('835f674b-2b51-49ea-acd5-6a176ad00616',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.576016] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe094fad-6ec3-4179-88a0-da40e49c0ff5: rpc.has_security_group_logging(os_id): False [ 766.594895] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.597148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.597148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.597148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.597148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.597148] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.597148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.597148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.597148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.597148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.597148] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.597148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.597148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.597148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.597148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.597717] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.597717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.597717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.597717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.598205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.600561] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 is going to be updated. [ 766.655877] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.657877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.657877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.657877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.657877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.674496] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: IN_PROGRESS for 2s [ 766.829343] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('817904c7-035a-41ce-bf21-c0db158c7bea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.027313] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-835f674b-2b51-49ea-acd5-6a176ad00616 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.027313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.027313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.027313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.027313] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.027313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.027313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.027313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.027313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.027313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.027725] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-835f674b-2b51-49ea-acd5-6a176ad00616 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.027725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.027725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.027897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.029095] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.029095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.029095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.029095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.029095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.029095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.029095] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('835f674b-2b51-49ea-acd5-6a176ad00616',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.332546] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.332546] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.332546] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.335408] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.335408] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.335408] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 817904c7-035a-41ce-bf21-c0db158c7bea is going to be created. [ 767.361454] env[68109]: INFO networking_nsxv3.common.synchronization [None req-810661d5-92d8-4b48-a8a1-a85ccd123b92 None None] Enqueued Resource ID: 079ca835-ef4d-462f-9c19-79ae3347ac1c with Priority: HIGHEST for action port [ 767.362835] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.362989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.363218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.363649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.363649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.367184] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 079ca835-ef4d-462f-9c19-79ae3347ac1c with Priority: HIGHEST for action port [ 767.367750] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-079ca835-ef4d-462f-9c19-79ae3347ac1c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.368160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-079ca835-ef4d-462f-9c19-79ae3347ac1c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.368394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-079ca835-ef4d-462f-9c19-79ae3347ac1c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.370481] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-079ca835-ef4d-462f-9c19-79ae3347ac1c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.370481] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('079ca835-ef4d-462f-9c19-79ae3347ac1c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.380726] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 817904c7-035a-41ce-bf21-c0db158c7bea in Status: UNINITIALIZED for 2s [ 767.508369] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 50s [ 767.534223] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 835f674b-2b51-49ea-acd5-6a176ad00616: rpc.has_security_group_logging(os_id): False [ 767.541474] env[68109]: INFO networking_nsxv3.common.synchronization [req-2cc9f8eb-0568-433c-ba5c-6fc1df73cd2d req-f28e2bce-be89-4a17-a76c-c3334475bd24 tempest-ServerGroupTestJSON-194445619 tempest-ServerGroupTestJSON-194445619-project-member] Enqueued Resource ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c with Priority: HIGHEST for action security_group_members [ 767.541985] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c with Priority: HIGHEST for action security_group_members [ 767.542299] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.542427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.542502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.542738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.542894] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.542995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.546514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.546514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.546514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.546514] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e79c46e7-8141-49ae-9d8a-e8124ebeb86c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.558024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.558024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.558024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.558024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.558024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.558024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.558024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.558024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.558024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.558024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.558024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.558024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.558024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.558024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.558024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.558742] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.558742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.558742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.558742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.558742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.558742] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 835f674b-2b51-49ea-acd5-6a176ad00616 is going to be created. [ 767.622655] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.622897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.623035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.623355] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.623575] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.636918] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 835f674b-2b51-49ea-acd5-6a176ad00616 in Status: IN_PROGRESS for 2s [ 767.872527] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 079ca835-ef4d-462f-9c19-79ae3347ac1c [ 767.872803] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.872976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.873076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.873389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.873490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.873703] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:079ca835-ef4d-462f-9c19-79ae3347ac1c already deleted. [ 767.873703] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-079ca835-ef4d-462f-9c19-79ae3347ac1c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.048222] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.048323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.048399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.048678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.048783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.048971] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.049086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.049151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.049308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.049386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.049470] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c already deleted. [ 768.049548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.050454] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-917 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.050649] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-917" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.050777] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-917" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.051140] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-917" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.051421] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.051584] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.051705] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.051935] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.052176] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.052248] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.052479] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.052479] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.052583] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.052677] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.052799] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.052904] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.072804] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.072804] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 768.072804] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.072804] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-917" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.072804] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-fb39609c-d4c4-4165-a23a-c551568249ee taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.073217] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-fb39609c-d4c4-4165-a23a-c551568249ee" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.073217] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-fb39609c-d4c4-4165-a23a-c551568249ee" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.073901] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-fb39609c-d4c4-4165-a23a-c551568249ee" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.073901] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb39609c-d4c4-4165-a23a-c551568249ee',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.577074] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.577421] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.577421] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.577714] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.578017] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.578259] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port fb39609c-d4c4-4165-a23a-c551568249ee not found, creating... [ 768.578571] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.578811] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.578991] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.579320] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.579491] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.579785] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.579970] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.580135] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.580367] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.580580] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.580752] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: fb39609c-d4c4-4165-a23a-c551568249ee is going to be created. [ 768.600759] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.601169] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.601427] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.601894] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.602301] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.602700] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-fb39609c-d4c4-4165-a23a-c551568249ee" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.697939] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: SUCCESS [ 768.698218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.698422] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.698659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.698748] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.071317] env[68109]: INFO networking_nsxv3.common.synchronization [req-342e488f-164b-4a89-acc0-1f4192cce791 req-d2158edc-b6ed-4edd-8400-705dc9dee179 tempest-ImagesNegativeTestJSON-262544493 tempest-ImagesNegativeTestJSON-262544493-project-member] Enqueued Resource ID: 820483a1-f34f-4ee1-b022-881132391bad with Priority: HIGHEST for action security_group_members [ 769.071892] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820483a1-f34f-4ee1-b022-881132391bad with Priority: HIGHEST for action security_group_members [ 769.074853] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-820483a1-f34f-4ee1-b022-881132391bad taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.074853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.074853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.074853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.074853] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.074853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.074853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.074853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.074853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.074853] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('820483a1-f34f-4ee1-b022-881132391bad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.201166] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.201430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.201527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.201917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.202042] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.202177] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.202264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.202476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.202593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.202715] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.202957] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.390870] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 817904c7-035a-41ce-bf21-c0db158c7bea in Status: SUCCESS [ 769.390870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.391796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.392024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.392242] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.392380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.392666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.392666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.392776] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.392825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.392880] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('817904c7-035a-41ce-bf21-c0db158c7bea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.401117] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-598 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.401117] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-598" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.401117] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-598" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.401117] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-598" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.401117] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.401117] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.401117] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.401117] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.401117] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.402415] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 769.402415] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 769.402415] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 769.402555] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 769.406057] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 769.406057] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 769.406057] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 769.424024] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 769.424024] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 769.424024] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 769.424024] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-598" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.424024] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-652fbce5-7048-4be5-815f-39c2cf801c98 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.424024] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-652fbce5-7048-4be5-815f-39c2cf801c98" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.424024] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-652fbce5-7048-4be5-815f-39c2cf801c98" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.424024] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-652fbce5-7048-4be5-815f-39c2cf801c98" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.424024] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('652fbce5-7048-4be5-815f-39c2cf801c98',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.519492] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 52s [ 769.581019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.581019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.581019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.581019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.581019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.581019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.581019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.581019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.581019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.581019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.581019] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820483a1-f34f-4ee1-b022-881132391bad already deleted. [ 769.581019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.646802] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 835f674b-2b51-49ea-acd5-6a176ad00616 in Status: SUCCESS [ 769.647254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.705853] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.706064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.706143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.707643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.707643] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.707643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.707643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.707643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.707643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.707643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.707643] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.707643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.708019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.708019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.708091] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.708311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.708311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.708510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.708618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.708892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.708892] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.719871] env[68109]: INFO networking_nsxv3.common.synchronization [req-2cc9f8eb-0568-433c-ba5c-6fc1df73cd2d req-209b67fb-3c45-4f5f-8c5f-408e6ffabe4b service nova] Enqueued Resource ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c with Priority: HIGHEST for action security_group_rules [ 769.720117] env[68109]: INFO networking_nsxv3.common.synchronization [req-2cc9f8eb-0568-433c-ba5c-6fc1df73cd2d req-209b67fb-3c45-4f5f-8c5f-408e6ffabe4b service nova] Enqueued Resource ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c with Priority: HIGHEST for action security_group_members [ 769.720272] env[68109]: INFO networking_nsxv3.common.synchronization [req-2cc9f8eb-0568-433c-ba5c-6fc1df73cd2d req-209b67fb-3c45-4f5f-8c5f-408e6ffabe4b service nova] Enqueued Resource ID: fb39609c-d4c4-4165-a23a-c551568249ee with Priority: HIGHEST for action port [ 769.720902] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c with Priority: HIGHEST for action security_group_rules [ 769.728357] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c with Priority: HIGHEST for action security_group_members [ 769.728357] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb39609c-d4c4-4165-a23a-c551568249ee with Priority: HIGHEST for action port [ 769.728357] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e79c46e7-8141-49ae-9d8a-e8124ebeb86c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.728357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.728357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.729738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.729738] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e79c46e7-8141-49ae-9d8a-e8124ebeb86c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.731275] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.731433] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.731898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.731898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.732142] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.732142] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.732142] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.732741] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.732880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.733103] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e79c46e7-8141-49ae-9d8a-e8124ebeb86c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.734094] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb39609c-d4c4-4165-a23a-c551568249ee taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.734278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb39609c-d4c4-4165-a23a-c551568249ee" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.734466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb39609c-d4c4-4165-a23a-c551568249ee" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.734638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb39609c-d4c4-4165-a23a-c551568249ee" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.734715] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb39609c-d4c4-4165-a23a-c551568249ee',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.906860] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('817904c7-035a-41ce-bf21-c0db158c7bea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.927597] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.927922] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.928109] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.928401] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.928601] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.928759] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 652fbce5-7048-4be5-815f-39c2cf801c98 not found, creating... [ 769.928978] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.929156] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.929517] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.929587] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.929680] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.929995] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.932457] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.932532] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.932713] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.932888] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.933063] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 652fbce5-7048-4be5-815f-39c2cf801c98 is going to be created. [ 769.974850] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.975086] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.975218] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.975507] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.975739] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.976017] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-652fbce5-7048-4be5-815f-39c2cf801c98" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.214622] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe094fad-6ec3-4179-88a0-da40e49c0ff5: rpc.has_security_group_logging(os_id): False [ 770.232771] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.233798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.233798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.233798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.233798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.234090] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.234090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.234090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.234252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.235022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.235022] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.235022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.235022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.235022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.235022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.235305] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.235305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.235305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.235425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.235499] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.235600] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 is going to be updated. [ 770.236878] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e79c46e7-8141-49ae-9d8a-e8124ebeb86c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.238114] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.238114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.238268] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb39609c-d4c4-4165-a23a-c551568249ee with status ACTIVE [ 770.238312] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.238473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.238473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.238608] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.238783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.238978] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.239115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.239180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.239332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.239449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.239587] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.239710] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.239792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.240051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.240051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.240130] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb39609c-d4c4-4165-a23a-c551568249ee is going to be updated. [ 770.266845] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.266980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.267071] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.267272] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.267407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.267562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb39609c-d4c4-4165-a23a-c551568249ee" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.321196] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.321439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.321488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.321910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.321910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.335832] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: IN_PROGRESS for 2s [ 770.407979] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 817904c7-035a-41ce-bf21-c0db158c7bea: rpc.has_security_group_logging(os_id): False [ 770.425782] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.425963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.426024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.426246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.426335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.426609] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.426722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.426779] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.426998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.427262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.427344] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 817904c7-035a-41ce-bf21-c0db158c7bea is going to be created. [ 770.510041] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.510192] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.510263] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.510483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.510684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.521139] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 817904c7-035a-41ce-bf21-c0db158c7bea in Status: IN_PROGRESS for 2s [ 770.673951] env[68109]: INFO networking_nsxv3.common.synchronization [req-342e488f-164b-4a89-acc0-1f4192cce791 req-0d4b8e65-9ff9-4b9b-9af2-238c77f36001 service nova] Enqueued Resource ID: 820483a1-f34f-4ee1-b022-881132391bad with Priority: HIGHEST for action security_group_rules [ 770.675095] env[68109]: INFO networking_nsxv3.common.synchronization [req-342e488f-164b-4a89-acc0-1f4192cce791 req-0d4b8e65-9ff9-4b9b-9af2-238c77f36001 service nova] Enqueued Resource ID: 820483a1-f34f-4ee1-b022-881132391bad with Priority: HIGHEST for action security_group_members [ 770.675095] env[68109]: INFO networking_nsxv3.common.synchronization [req-342e488f-164b-4a89-acc0-1f4192cce791 req-0d4b8e65-9ff9-4b9b-9af2-238c77f36001 service nova] Enqueued Resource ID: 652fbce5-7048-4be5-815f-39c2cf801c98 with Priority: HIGHEST for action port [ 770.675095] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820483a1-f34f-4ee1-b022-881132391bad with Priority: HIGHEST for action security_group_rules [ 770.675323] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820483a1-f34f-4ee1-b022-881132391bad with Priority: HIGHEST for action security_group_members [ 770.675323] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 652fbce5-7048-4be5-815f-39c2cf801c98 with Priority: HIGHEST for action port [ 770.675530] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-820483a1-f34f-4ee1-b022-881132391bad taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.677021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.677021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.677021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.677021] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('820483a1-f34f-4ee1-b022-881132391bad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.678415] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-820483a1-f34f-4ee1-b022-881132391bad taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.678545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.678621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.678823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.679638] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.679638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.679638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.679638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.679638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.679638] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('820483a1-f34f-4ee1-b022-881132391bad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.680347] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-652fbce5-7048-4be5-815f-39c2cf801c98 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.680473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-652fbce5-7048-4be5-815f-39c2cf801c98" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.680554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-652fbce5-7048-4be5-815f-39c2cf801c98" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.680788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-652fbce5-7048-4be5-815f-39c2cf801c98" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.680908] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('652fbce5-7048-4be5-815f-39c2cf801c98',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.743028] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e79c46e7-8141-49ae-9d8a-e8124ebeb86c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.184480] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('820483a1-f34f-4ee1-b022-881132391bad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.186670] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-820483a1-f34f-4ee1-b022-881132391bad taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.186670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.186670] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 652fbce5-7048-4be5-815f-39c2cf801c98 with status ACTIVE [ 771.186670] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.186670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.186670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.186907] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.186936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.187146] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.187834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.187834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.187834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.187834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.187834] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.187834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.188108] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.188108] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.188108] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.188183] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 652fbce5-7048-4be5-815f-39c2cf801c98 is going to be updated. [ 771.212448] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.212448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.212642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.212698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.212934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.213080] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-652fbce5-7048-4be5-815f-39c2cf801c98" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.244647] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.244837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.244904] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.245159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.245255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.245370] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c is going to be created. [ 771.340899] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.341107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.341151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.341407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.341582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.353316] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c in Status: UNINITIALIZED for 2s [ 771.532058] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 54s [ 771.691442] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('820483a1-f34f-4ee1-b022-881132391bad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.936794] env[68109]: INFO networking_nsxv3.common.synchronization [req-076891f4-9b4e-4dbe-81d9-1f58f3925ee2 req-3d78d551-db86-43cd-9fc4-6cf6d1fe727a tempest-ServerActionsV293TestJSON-1191773725 tempest-ServerActionsV293TestJSON-1191773725-project-member] Enqueued Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGHEST for action security_group_members [ 771.937338] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGHEST for action security_group_members [ 771.937863] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1589ee36-8ec7-4a35-a6c9-857230faca44 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.942019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.942019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.942019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.942019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.942019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.942019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.942019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.942019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.942019] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1589ee36-8ec7-4a35-a6c9-857230faca44',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.195676] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.195804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.195889] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.196124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.196212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.196305] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820483a1-f34f-4ee1-b022-881132391bad is going to be created. [ 772.225954] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.226182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.226182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.226394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.226553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.239092] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820483a1-f34f-4ee1-b022-881132391bad in Status: UNINITIALIZED for 2s [ 772.263215] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-18 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.264174] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-18" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.264174] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-18" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.264174] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-18" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.265083] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.265083] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.265083] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.265641] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.265641] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.265641] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 772.265984] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 772.265984] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 772.266134] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 772.266211] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 772.266719] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 772.266719] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 772.288153] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 772.288320] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 772.288465] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 772.288641] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-18" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.289161] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-5445188d-61db-48cc-8e79-91e91607df9e taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.289303] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-5445188d-61db-48cc-8e79-91e91607df9e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.289450] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-5445188d-61db-48cc-8e79-91e91607df9e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.289776] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-5445188d-61db-48cc-8e79-91e91607df9e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.289914] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5445188d-61db-48cc-8e79-91e91607df9e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.350144] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: SUCCESS [ 772.351162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.444654] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.444654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.444797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.445050] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.445297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.445473] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.446395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.446395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.446395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.446395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.446395] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 already deleted. [ 772.446395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.532113] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 817904c7-035a-41ce-bf21-c0db158c7bea in Status: SUCCESS [ 772.532396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.793810] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.794142] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.794265] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.794582] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.794741] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.794902] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 5445188d-61db-48cc-8e79-91e91607df9e not found, creating... [ 772.795191] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.795350] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.795466] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.795729] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.795871] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.796200] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.796388] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.796471] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.796709] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.796843] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.796996] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 5445188d-61db-48cc-8e79-91e91607df9e is going to be created. [ 772.815292] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.815553] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.815882] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.815993] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.816253] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.816487] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-5445188d-61db-48cc-8e79-91e91607df9e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.362965] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c in Status: SUCCESS [ 773.364775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.364775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.364775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.364775] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.364775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.364775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.364775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.364775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.364775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.364775] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e79c46e7-8141-49ae-9d8a-e8124ebeb86c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.544054] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 56s [ 773.745586] env[68109]: INFO networking_nsxv3.common.synchronization [req-076891f4-9b4e-4dbe-81d9-1f58f3925ee2 req-978a9949-eec0-48c1-9e1f-07fe99eb9462 service nova] Enqueued Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGHEST for action security_group_rules [ 773.745925] env[68109]: INFO networking_nsxv3.common.synchronization [req-076891f4-9b4e-4dbe-81d9-1f58f3925ee2 req-978a9949-eec0-48c1-9e1f-07fe99eb9462 service nova] Enqueued Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGHEST for action security_group_members [ 773.746018] env[68109]: INFO networking_nsxv3.common.synchronization [req-076891f4-9b4e-4dbe-81d9-1f58f3925ee2 req-978a9949-eec0-48c1-9e1f-07fe99eb9462 service nova] Enqueued Resource ID: 5445188d-61db-48cc-8e79-91e91607df9e with Priority: HIGHEST for action port [ 773.746681] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGHEST for action security_group_rules [ 773.746681] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGHEST for action security_group_members [ 773.746863] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5445188d-61db-48cc-8e79-91e91607df9e with Priority: HIGHEST for action port [ 773.747082] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1589ee36-8ec7-4a35-a6c9-857230faca44 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.747210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.747275] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.747674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.747674] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1589ee36-8ec7-4a35-a6c9-857230faca44',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.750107] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1589ee36-8ec7-4a35-a6c9-857230faca44 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.750241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.750296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.750681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.750681] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.750953] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.750953] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.750953] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.752075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.752075] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1589ee36-8ec7-4a35-a6c9-857230faca44',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.752075] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-5445188d-61db-48cc-8e79-91e91607df9e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.752421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5445188d-61db-48cc-8e79-91e91607df9e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.752503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5445188d-61db-48cc-8e79-91e91607df9e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.752690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5445188d-61db-48cc-8e79-91e91607df9e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.752762] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5445188d-61db-48cc-8e79-91e91607df9e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.871193] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.871658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.871658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.871834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.871834] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.871940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.871977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.872150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.873591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.873591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.873591] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.873591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.873591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.873834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.873892] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.874136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.874136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.874230] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.874281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.874360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.874448] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e79c46e7-8141-49ae-9d8a-e8124ebeb86c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.250105] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820483a1-f34f-4ee1-b022-881132391bad in Status: SUCCESS [ 774.250522] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.250522] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.250782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.251022] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.251186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.251270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.251469] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.251577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.251648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.251743] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('820483a1-f34f-4ee1-b022-881132391bad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.258075] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1589ee36-8ec7-4a35-a6c9-857230faca44 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.258075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.258075] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5445188d-61db-48cc-8e79-91e91607df9e with status ACTIVE [ 774.258075] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.258075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.258075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.258075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.258075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.258075] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.258075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.258075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.258075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.258075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.258593] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.258593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.258593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.258593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.258593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.258593] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5445188d-61db-48cc-8e79-91e91607df9e is going to be updated. [ 774.264108] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1589ee36-8ec7-4a35-a6c9-857230faca44',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.284361] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.284501] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.284565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.284776] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.284908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.285091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5445188d-61db-48cc-8e79-91e91607df9e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.377309] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e79c46e7-8141-49ae-9d8a-e8124ebeb86c: rpc.has_security_group_logging(os_id): False [ 774.400407] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.400562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.400633] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.400851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.400943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.401792] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.401921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.402021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.402219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.402327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.402545] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.402666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.402754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.402916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.402995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.403185] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.403317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.403395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.403555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.403644] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.403734] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c is going to be created. [ 774.487199] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.487449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.487525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.487768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.487968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.505989] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c in Status: IN_PROGRESS for 2s [ 774.757499] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-820483a1-f34f-4ee1-b022-881132391bad taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.757761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.757883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.758231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.758489] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.758774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.758774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.759076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.759242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.759421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.759695] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-820483a1-f34f-4ee1-b022-881132391bad taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.759890] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.759923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.760562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.760562] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.761174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.761174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.761174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.761309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.761434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.761667] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('820483a1-f34f-4ee1-b022-881132391bad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.766012] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1589ee36-8ec7-4a35-a6c9-857230faca44',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.264642] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 820483a1-f34f-4ee1-b022-881132391bad: rpc.has_security_group_logging(os_id): False [ 775.269923] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.270163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.270274] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.270493] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.270591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.270683] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 is going to be created. [ 775.285495] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.285676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.285759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.286077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.286124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.286303] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.286402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.286464] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.286622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.286693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.286885] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.286980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.287057] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.287212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.287287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.287474] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.287567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.287623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.287763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.289463] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.289614] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 820483a1-f34f-4ee1-b022-881132391bad is going to be created. [ 775.296538] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.296911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.296911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.297058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.297209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.306150] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: UNINITIALIZED for 2s [ 775.357048] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.357205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.357271] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.358029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.358029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.371455] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 820483a1-f34f-4ee1-b022-881132391bad in Status: IN_PROGRESS for 2s [ 775.385181] env[68109]: INFO networking_nsxv3.common.synchronization [req-4217f3b0-e57d-4b02-934a-b666bab52096 req-1af97fc3-6f66-48dd-a24b-5061ae4a1ab1 tempest-MultipleCreateTestJSON-181458045 tempest-MultipleCreateTestJSON-181458045-project-member] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 775.385719] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 775.386061] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.386194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.386263] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.386521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.386678] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.386779] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.386839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.386995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.387113] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.387212] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.557983] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 58s [ 775.855195] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.855195] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.855195] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.856013] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.856013] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.856013] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.856246] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.856370] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.856562] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.856802] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.857139] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.857284] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.858029] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.858029] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.858029] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.858029] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.875994] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.876217] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 775.876365] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.876570] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.876913] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-d5c25f13-5f7a-4e75-9e03-d4f20307b375 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.877106] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-d5c25f13-5f7a-4e75-9e03-d4f20307b375" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.877275] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-d5c25f13-5f7a-4e75-9e03-d4f20307b375" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.877599] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-d5c25f13-5f7a-4e75-9e03-d4f20307b375" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.877746] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5c25f13-5f7a-4e75-9e03-d4f20307b375',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.890047] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.890338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.890338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.890601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.890697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.890925] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.891030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.891091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.891293] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.891371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.891453] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc already deleted. [ 775.891545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.386170] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.386170] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.386170] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.386170] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.386170] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.386170] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port d5c25f13-5f7a-4e75-9e03-d4f20307b375 not found, creating... [ 776.386170] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.386170] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.386713] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.386713] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.390324] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.390324] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.390324] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.390324] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.390324] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.390324] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.390324] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: d5c25f13-5f7a-4e75-9e03-d4f20307b375 is going to be created. [ 776.413831] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.414177] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.414327] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.414679] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.414982] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.415381] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-d5c25f13-5f7a-4e75-9e03-d4f20307b375" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.519319] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c in Status: SUCCESS [ 776.519642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.316223] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: SUCCESS [ 777.317508] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.319127] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.319410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.319619] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.319740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.319803] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.319956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.320058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.320143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.320366] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1589ee36-8ec7-4a35-a6c9-857230faca44',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.384246] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 820483a1-f34f-4ee1-b022-881132391bad in Status: SUCCESS [ 777.385267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.570802] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 60s [ 777.824209] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1589ee36-8ec7-4a35-a6c9-857230faca44',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.827441] env[68109]: INFO networking_nsxv3.common.synchronization [req-4217f3b0-e57d-4b02-934a-b666bab52096 req-a5568565-3c1a-4a2f-8105-a666e430324f service nova] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_rules [ 777.827694] env[68109]: INFO networking_nsxv3.common.synchronization [req-4217f3b0-e57d-4b02-934a-b666bab52096 req-a5568565-3c1a-4a2f-8105-a666e430324f service nova] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 777.827946] env[68109]: INFO networking_nsxv3.common.synchronization [req-4217f3b0-e57d-4b02-934a-b666bab52096 req-a5568565-3c1a-4a2f-8105-a666e430324f service nova] Enqueued Resource ID: d5c25f13-5f7a-4e75-9e03-d4f20307b375 with Priority: HIGHEST for action port [ 777.828813] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_rules [ 777.828950] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 777.829060] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5c25f13-5f7a-4e75-9e03-d4f20307b375 with Priority: HIGHEST for action port [ 777.829345] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.829471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.829538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.829890] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.830012] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.832053] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.832053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.832053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.832053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.832053] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.832609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.832648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.833029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.833029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.833029] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.833945] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5c25f13-5f7a-4e75-9e03-d4f20307b375 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.834089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5c25f13-5f7a-4e75-9e03-d4f20307b375" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.834089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5c25f13-5f7a-4e75-9e03-d4f20307b375" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.834478] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5c25f13-5f7a-4e75-9e03-d4f20307b375" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.834478] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5c25f13-5f7a-4e75-9e03-d4f20307b375',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.949420] env[68109]: INFO networking_nsxv3.common.synchronization [req-71d672ca-302c-4bb8-a890-72a53cfa69d5 req-de5c2a70-ee1b-4f9f-9fd1-da4208e47a6f tempest-AttachInterfacesV270Test-1687339747 tempest-AttachInterfacesV270Test-1687339747-project-member] Enqueued Resource ID: 835f674b-2b51-49ea-acd5-6a176ad00616 with Priority: HIGHEST for action security_group_members [ 777.950040] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835f674b-2b51-49ea-acd5-6a176ad00616 with Priority: HIGHEST for action security_group_members [ 777.951944] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-835f674b-2b51-49ea-acd5-6a176ad00616 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.951944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.951944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.951944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.951944] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.951944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.951944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.952352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.952486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.952620] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('835f674b-2b51-49ea-acd5-6a176ad00616',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.329534] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1589ee36-8ec7-4a35-a6c9-857230faca44: rpc.has_security_group_logging(os_id): False [ 778.337774] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.337918] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.339408] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.339408] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5c25f13-5f7a-4e75-9e03-d4f20307b375 with status ACTIVE [ 778.339408] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.339408] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.339625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.339717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.339852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.340225] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.340225] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.340360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.340417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.340514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.340744] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.340800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.340985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.340985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.346332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.346567] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5c25f13-5f7a-4e75-9e03-d4f20307b375 is going to be updated. [ 778.348852] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.352580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.352580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.352580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.352580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.352580] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.352580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.352580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.354228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.354512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.354744] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 is going to be created. [ 778.390359] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.390498] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.390567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.390784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.390914] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.391133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5c25f13-5f7a-4e75-9e03-d4f20307b375" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.428944] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.429148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.429353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.429429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.430129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.439561] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: IN_PROGRESS for 2s [ 778.454941] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.455235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.455235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.455483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.455583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.455796] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.455913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.455950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.456158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.456240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.456332] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 835f674b-2b51-49ea-acd5-6a176ad00616 is going to be updated. [ 778.518958] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.519182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.519182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.519417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.519568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.536763] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 835f674b-2b51-49ea-acd5-6a176ad00616 in Status: IN_PROGRESS for 2s [ 778.677549] env[68109]: INFO networking_nsxv3.common.synchronization [None req-7312602e-f428-4365-9160-fd4f0b4adced None None] Enqueued Resource ID: 90f40f88-2e6c-4dda-8791-88f023906c8b with Priority: HIGHEST for action port [ 778.677549] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90f40f88-2e6c-4dda-8791-88f023906c8b with Priority: HIGHEST for action port [ 778.677942] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-90f40f88-2e6c-4dda-8791-88f023906c8b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.677942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90f40f88-2e6c-4dda-8791-88f023906c8b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.677942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90f40f88-2e6c-4dda-8791-88f023906c8b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.678347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90f40f88-2e6c-4dda-8791-88f023906c8b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.678433] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90f40f88-2e6c-4dda-8791-88f023906c8b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.857912] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.916286] env[68109]: INFO networking_nsxv3.common.synchronization [None req-26e6d413-c313-4c2d-92d3-da0468e0537b None None] Enqueued Resource ID: 5780c0f8-2943-4daa-93ad-3e6599255196 with Priority: HIGHEST for action port [ 778.916286] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5780c0f8-2943-4daa-93ad-3e6599255196 with Priority: HIGHEST for action port [ 778.916286] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-5780c0f8-2943-4daa-93ad-3e6599255196 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.916286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5780c0f8-2943-4daa-93ad-3e6599255196" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.916286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5780c0f8-2943-4daa-93ad-3e6599255196" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.916286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5780c0f8-2943-4daa-93ad-3e6599255196" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.916286] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5780c0f8-2943-4daa-93ad-3e6599255196',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.171065] env[68109]: INFO networking_nsxv3.common.synchronization [None req-bc356e46-125e-41b9-89cf-f7b78aef6e13 tempest-MigrationsAdminTest-481783089 tempest-MigrationsAdminTest-481783089-project-member] Enqueued Resource ID: a6f0fce7-57af-425c-8abf-ab2b7813d11b with Priority: HIGHEST for action security_group_rules [ 779.171065] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f0fce7-57af-425c-8abf-ab2b7813d11b with Priority: HIGHEST for action security_group_rules [ 779.171065] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6f0fce7-57af-425c-8abf-ab2b7813d11b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.171260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6f0fce7-57af-425c-8abf-ab2b7813d11b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.171260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6f0fce7-57af-425c-8abf-ab2b7813d11b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.171563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6f0fce7-57af-425c-8abf-ab2b7813d11b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.171643] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6f0fce7-57af-425c-8abf-ab2b7813d11b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.180931] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90f40f88-2e6c-4dda-8791-88f023906c8b [ 779.181037] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.181426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.181426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.181426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.181565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.181593] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90f40f88-2e6c-4dda-8791-88f023906c8b already deleted. [ 779.182885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90f40f88-2e6c-4dda-8791-88f023906c8b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.316412] env[68109]: INFO networking_nsxv3.common.synchronization [None req-447866db-06b0-4ba4-b995-7f2b0cb29f53 tempest-MigrationsAdminTest-481783089 tempest-MigrationsAdminTest-481783089-project-member] Enqueued Resource ID: a6f0fce7-57af-425c-8abf-ab2b7813d11b with Priority: HIGHEST for action security_group_rules [ 779.317577] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f0fce7-57af-425c-8abf-ab2b7813d11b with Priority: HIGHEST for action security_group_rules [ 779.317890] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6f0fce7-57af-425c-8abf-ab2b7813d11b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.318053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6f0fce7-57af-425c-8abf-ab2b7813d11b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.362604] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.362604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.362604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.362749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.362807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.362916] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be created. [ 779.386065] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.386231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.386301] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.386509] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.386661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.403217] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: UNINITIALIZED for 2s [ 779.424283] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5780c0f8-2943-4daa-93ad-3e6599255196 [ 779.424427] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.425570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.425570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.425570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.425570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.425570] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5780c0f8-2943-4daa-93ad-3e6599255196 already deleted. [ 779.425570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5780c0f8-2943-4daa-93ad-3e6599255196" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.583531] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 62s [ 779.701568] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.701568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.701568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.701891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.701891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.701946] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6f0fce7-57af-425c-8abf-ab2b7813d11b already deleted. [ 779.703234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6f0fce7-57af-425c-8abf-ab2b7813d11b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.703234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6f0fce7-57af-425c-8abf-ab2b7813d11b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.703234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6f0fce7-57af-425c-8abf-ab2b7813d11b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.703234] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6f0fce7-57af-425c-8abf-ab2b7813d11b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.227108] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.227265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.227339] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.227613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.227707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.227821] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6f0fce7-57af-425c-8abf-ab2b7813d11b already deleted. [ 780.227915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6f0fce7-57af-425c-8abf-ab2b7813d11b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.452072] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: SUCCESS [ 780.452072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.549476] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 835f674b-2b51-49ea-acd5-6a176ad00616 in Status: SUCCESS [ 780.549476] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 835f674b-2b51-49ea-acd5-6a176ad00616 deletion is rescheduled due to dependency. [ 780.549476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.769861] env[68109]: INFO networking_nsxv3.common.synchronization [req-fd92aff5-1602-43d2-aa68-caa4a5cc6d00 req-d75f5e6d-cf9d-479e-ba2c-77011fa9f1c7 tempest-ImagesTestJSON-447768907 tempest-ImagesTestJSON-447768907-project-member] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 780.770339] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 780.770616] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.770740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.770809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.771012] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.774640] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.774764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.774842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.775050] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.776075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.776187] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.072409] env[68109]: INFO networking_nsxv3.common.synchronization [None req-82e93cc5-cd98-447a-a669-ddc1046178b7 None None] Enqueued Resource ID: 0deac9a9-b9fc-418f-ab1e-5033a9d814e6 with Priority: HIGHEST for action port [ 781.072409] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0deac9a9-b9fc-418f-ab1e-5033a9d814e6 with Priority: HIGHEST for action port [ 781.072409] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0deac9a9-b9fc-418f-ab1e-5033a9d814e6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.072409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0deac9a9-b9fc-418f-ab1e-5033a9d814e6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.072409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0deac9a9-b9fc-418f-ab1e-5033a9d814e6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.072409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0deac9a9-b9fc-418f-ab1e-5033a9d814e6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.072409] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0deac9a9-b9fc-418f-ab1e-5033a9d814e6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.282395] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.282395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.282395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.282395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.282395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.282395] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.282395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.282395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.282395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.282395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.282395] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be updated. [ 781.306587] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.308625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.308625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.308625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.308625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.317160] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 781.412184] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 781.412987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.413133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.413655] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.413723] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.413852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.413934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.414151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.414296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.414451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.414630] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.576797] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0deac9a9-b9fc-418f-ab1e-5033a9d814e6 [ 781.576797] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.577765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.578191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.579096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.579096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.579096] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0deac9a9-b9fc-418f-ab1e-5033a9d814e6 already deleted. [ 781.579096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0deac9a9-b9fc-418f-ab1e-5033a9d814e6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.607086] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 64s [ 781.919276] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.919528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.919528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.919741] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.919907] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.920012] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.920203] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.920264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.921215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.921215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.921215] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.921215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.921215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.921215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.921215] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.921215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.921215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.921643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.921643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.921643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.921643] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.985269] env[68109]: INFO networking_nsxv3.common.synchronization [None req-fd07286e-35ca-4d61-878f-dc3854141ac3 None None] Enqueued Resource ID: d357b9d2-9263-4ced-b695-8abd4fcdcdc3 with Priority: HIGHEST for action port [ 781.985421] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d357b9d2-9263-4ced-b695-8abd4fcdcdc3 with Priority: HIGHEST for action port [ 781.987104] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-d357b9d2-9263-4ced-b695-8abd4fcdcdc3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.987104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d357b9d2-9263-4ced-b695-8abd4fcdcdc3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.987104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d357b9d2-9263-4ced-b695-8abd4fcdcdc3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.987104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d357b9d2-9263-4ced-b695-8abd4fcdcdc3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.987104] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d357b9d2-9263-4ced-b695-8abd4fcdcdc3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.426161] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 327a22ab-0003-41d7-851d-6eba37a2b9dc: rpc.has_security_group_logging(os_id): False [ 782.446476] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.449516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.449516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.449664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.449741] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.450019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.450127] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.450199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.450367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.450451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.450636] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.450733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.450796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.450937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.451023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.451206] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.451326] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.451358] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.451485] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.451563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.451676] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be created. [ 782.490584] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d357b9d2-9263-4ced-b695-8abd4fcdcdc3 [ 782.490952] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.492651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.492651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.492651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.492651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.492651] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d357b9d2-9263-4ced-b695-8abd4fcdcdc3 already deleted. [ 782.492651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d357b9d2-9263-4ced-b695-8abd4fcdcdc3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.523675] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.523675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.523675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.523675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.523675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.532127] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 2s [ 782.801410] env[68109]: INFO networking_nsxv3.common.synchronization [req-1f8bcb47-9258-4a7b-afba-e6404b7dce17 req-869e5a24-6680-4d15-88a6-2c54c8ecf74f tempest-ServerGroupTestJSON-194445619 tempest-ServerGroupTestJSON-194445619-project-member] Enqueued Resource ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c with Priority: HIGHEST for action security_group_members [ 782.801410] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c with Priority: HIGHEST for action security_group_members [ 782.801410] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.801410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.801410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.801410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.801410] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.801410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.801410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.801410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.801410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.801410] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e79c46e7-8141-49ae-9d8a-e8124ebeb86c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.041243] env[68109]: INFO networking_nsxv3.common.synchronization [req-622d8f62-f96a-4a3f-8133-277a664990c5 req-4d37bb01-e7d3-45d5-9dbe-f176de948671 tempest-ImagesNegativeTestJSON-262544493 tempest-ImagesNegativeTestJSON-262544493-project-member] Enqueued Resource ID: 820483a1-f34f-4ee1-b022-881132391bad with Priority: HIGHEST for action security_group_members [ 783.041795] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820483a1-f34f-4ee1-b022-881132391bad with Priority: HIGHEST for action security_group_members [ 783.042083] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-820483a1-f34f-4ee1-b022-881132391bad taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.042226] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.042291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.042575] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.042736] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.042928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.042928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.043797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.043925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.044057] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('820483a1-f34f-4ee1-b022-881132391bad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.303054] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.303215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.303286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.303607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.303707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.303909] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.304023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.304093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.304225] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.304302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.304387] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c is going to be updated. [ 783.324814] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 783.325025] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 deletion is rescheduled due to dependency. [ 783.325494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.332021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.332160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.332160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.332347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.332479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.339914] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c in Status: IN_PROGRESS for 2s [ 783.546086] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.547189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.547443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.547608] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.547671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.547871] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.547975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.548050] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.548214] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.548291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.548379] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820483a1-f34f-4ee1-b022-881132391bad is going to be updated. [ 783.577425] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.577425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.577425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.577626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.577763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.586221] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820483a1-f34f-4ee1-b022-881132391bad in Status: IN_PROGRESS for 2s [ 783.617667] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 66s [ 783.789278] env[68109]: INFO networking_nsxv3.common.synchronization [req-4217f3b0-e57d-4b02-934a-b666bab52096 req-b8f9e62a-1057-4b5f-8742-edfcc5cd5098 tempest-MultipleCreateTestJSON-181458045 tempest-MultipleCreateTestJSON-181458045-project-member] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 783.789822] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 783.790681] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.790807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.790874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.791096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.791286] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.791395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.791482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.791615] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.791702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.791793] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.081965] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.082263] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.086019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.086019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.086019] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.086019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.086019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.086019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.086019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.086019] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.086019] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.086019] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.086019] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.086582] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.086582] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.086807] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.104691] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.104831] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 784.104917] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.105096] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.105890] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-20b055fb-af2d-4021-a713-0ae155a55a67 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.105890] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-20b055fb-af2d-4021-a713-0ae155a55a67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.105890] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-20b055fb-af2d-4021-a713-0ae155a55a67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.106241] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-20b055fb-af2d-4021-a713-0ae155a55a67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.106363] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20b055fb-af2d-4021-a713-0ae155a55a67',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.293283] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.547449] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 784.547679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.609957] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.610222] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.610351] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.610649] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.610802] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.610961] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 20b055fb-af2d-4021-a713-0ae155a55a67 not found, creating... [ 784.611247] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.611491] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.611624] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.611845] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.611982] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.612288] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.612939] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.613498] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.614040] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.614266] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.614939] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 20b055fb-af2d-4021-a713-0ae155a55a67 is going to be created. [ 784.643563] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.643796] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.643928] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.644223] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.644523] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.644785] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-20b055fb-af2d-4021-a713-0ae155a55a67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.796076] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.301729] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.302050] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.302050] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.302218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.302300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.302403] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be updated. [ 785.332822] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.332982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.333041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.333231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.333381] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.342767] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 2s [ 785.348311] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c in Status: SUCCESS [ 785.348507] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c deletion is rescheduled due to dependency. [ 785.348660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.367198] env[68109]: INFO networking_nsxv3.common.synchronization [req-4217f3b0-e57d-4b02-934a-b666bab52096 req-ca6a535f-dff4-458a-a6ef-2eac311deda3 service nova] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_rules [ 785.367394] env[68109]: INFO networking_nsxv3.common.synchronization [req-4217f3b0-e57d-4b02-934a-b666bab52096 req-ca6a535f-dff4-458a-a6ef-2eac311deda3 service nova] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 785.367538] env[68109]: INFO networking_nsxv3.common.synchronization [req-4217f3b0-e57d-4b02-934a-b666bab52096 req-ca6a535f-dff4-458a-a6ef-2eac311deda3 service nova] Enqueued Resource ID: 20b055fb-af2d-4021-a713-0ae155a55a67 with Priority: HIGHEST for action port [ 785.368045] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_rules [ 785.368045] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 785.368175] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20b055fb-af2d-4021-a713-0ae155a55a67 with Priority: HIGHEST for action port [ 785.368683] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.368809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.368928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.369114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.369205] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.370089] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.370149] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.370291] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-20b055fb-af2d-4021-a713-0ae155a55a67 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.370389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20b055fb-af2d-4021-a713-0ae155a55a67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.370455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20b055fb-af2d-4021-a713-0ae155a55a67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.370620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20b055fb-af2d-4021-a713-0ae155a55a67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.370690] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20b055fb-af2d-4021-a713-0ae155a55a67',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.595990] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820483a1-f34f-4ee1-b022-881132391bad in Status: IN_PROGRESS for 4s [ 785.630980] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 68s [ 785.872152] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.872286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.872528] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20b055fb-af2d-4021-a713-0ae155a55a67 with status ACTIVE [ 785.872734] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.873561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.873561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.873561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.873561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.873561] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.873787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.873787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.873916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.873916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.874124] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.874232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.874294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.874455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.874532] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.874621] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20b055fb-af2d-4021-a713-0ae155a55a67 is going to be updated. [ 785.895230] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.895416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.895453] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.895764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.895853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.895940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20b055fb-af2d-4021-a713-0ae155a55a67" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.474522] env[68109]: INFO networking_nsxv3.common.synchronization [req-c6a5a459-7165-4e53-96e5-80e8451c5ec7 req-c05fc930-ca58-4d57-ad60-cf92fb338dd2 tempest-ListServerFiltersTestJSON-53590806 tempest-ListServerFiltersTestJSON-53590806-project-member] Enqueued Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 786.475423] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 786.475761] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.475917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.475993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.476288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.476475] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.476584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.476666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.476858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.476957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.477087] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.819189] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-174 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.819389] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.819506] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.819844] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.820128] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.820274] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.820388] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.820605] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.820733] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.820946] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.822502] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.822640] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.822758] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.822877] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.822989] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.823138] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.841650] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.841801] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 786.841930] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.842109] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.842386] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-41b33893-5f1e-4808-98f3-fad05b50110e taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.842574] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-41b33893-5f1e-4808-98f3-fad05b50110e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.842659] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-41b33893-5f1e-4808-98f3-fad05b50110e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.842936] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-41b33893-5f1e-4808-98f3-fad05b50110e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.843085] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41b33893-5f1e-4808-98f3-fad05b50110e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.979185] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.979337] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.979405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.979611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.979699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.979878] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.979965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.980039] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.980196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.980268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.980349] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 already deleted. [ 786.980424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.344945] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.345193] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.345324] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.345593] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.345739] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.345890] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 41b33893-5f1e-4808-98f3-fad05b50110e not found, creating... [ 787.346161] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.346314] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.346431] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.346876] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.347066] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.347349] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.347506] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.347623] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.347849] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.348011] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.348162] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 41b33893-5f1e-4808-98f3-fad05b50110e is going to be created. [ 787.356746] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 787.356948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.357117] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.357300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.357461] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.357765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.357765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.357765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.357846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.357936] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.368817] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.369096] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.369250] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.370069] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.370069] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.370069] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-41b33893-5f1e-4808-98f3-fad05b50110e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.605292] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820483a1-f34f-4ee1-b022-881132391bad in Status: SUCCESS [ 787.605582] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820483a1-f34f-4ee1-b022-881132391bad deletion is rescheduled due to dependency. [ 787.605582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.645986] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 70s [ 787.864441] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.173994] env[68109]: INFO networking_nsxv3.common.synchronization [req-c6a5a459-7165-4e53-96e5-80e8451c5ec7 req-b515744d-d59c-4f32-9880-07f7cef67d40 service nova] Enqueued Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_rules [ 788.174179] env[68109]: INFO networking_nsxv3.common.synchronization [req-c6a5a459-7165-4e53-96e5-80e8451c5ec7 req-b515744d-d59c-4f32-9880-07f7cef67d40 service nova] Enqueued Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 788.174328] env[68109]: INFO networking_nsxv3.common.synchronization [req-c6a5a459-7165-4e53-96e5-80e8451c5ec7 req-b515744d-d59c-4f32-9880-07f7cef67d40 service nova] Enqueued Resource ID: 41b33893-5f1e-4808-98f3-fad05b50110e with Priority: HIGHEST for action port [ 788.174629] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_rules [ 788.174770] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 788.174863] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41b33893-5f1e-4808-98f3-fad05b50110e with Priority: HIGHEST for action port [ 788.175459] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.175567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.175631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.177915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.177915] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.178343] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.178479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.179095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.179095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.179095] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.179095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.179095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.179290] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.179416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.179455] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.180253] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-41b33893-5f1e-4808-98f3-fad05b50110e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.180369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41b33893-5f1e-4808-98f3-fad05b50110e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.180436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41b33893-5f1e-4808-98f3-fad05b50110e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.180611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41b33893-5f1e-4808-98f3-fad05b50110e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.180688] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41b33893-5f1e-4808-98f3-fad05b50110e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.366985] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.683478] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.683778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.683819] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.684733] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41b33893-5f1e-4808-98f3-fad05b50110e with status ACTIVE [ 788.684916] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.685040] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.685118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.685307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.685384] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.685593] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.685641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.685699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.685877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.685959] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.686259] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.686357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.686437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.686597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.686630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.686698] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41b33893-5f1e-4808-98f3-fad05b50110e is going to be updated. [ 788.707641] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.707855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.707947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.708184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.708405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.708572] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41b33893-5f1e-4808-98f3-fad05b50110e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.869402] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.869561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.869963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.869963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.869963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.870249] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be updated. [ 788.910791] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.910953] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.911024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.911251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.911396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.919641] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 2s [ 789.188630] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.668526] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 72s [ 789.692179] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.692179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.692179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.692179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.692179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.692179] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 is going to be created. [ 789.714457] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.714616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.714664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.714870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.715046] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.723469] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: UNINITIALIZED for 2s [ 790.601658] env[68109]: INFO networking_nsxv3.common.synchronization [req-87a70eff-5556-404c-99ae-35634b978890 req-16c77598-c6ff-48ce-bbb1-891c0f354508 tempest-ServersTestJSON-881419211 tempest-ServersTestJSON-881419211-project-member] Enqueued Resource ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 with Priority: HIGHEST for action security_group_members [ 790.602229] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 with Priority: HIGHEST for action security_group_members [ 790.602538] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.602655] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.602715] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.602920] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.604728] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.604862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.604937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.605152] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.605248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.605347] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.933616] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 790.933616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.933931] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.933931] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.934130] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.934251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.934311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.934497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.934583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.934674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.934766] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.099124] env[68109]: INFO networking_nsxv3.common.synchronization [req-1f57bc26-1121-4153-a47b-08ea3a7a0624 req-9af3f899-e2a3-4e98-9e8f-0aec4c37eb32 tempest-ListServerFiltersTestJSON-53590806 tempest-ListServerFiltersTestJSON-53590806-project-member] Enqueued Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 791.099723] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 791.102255] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.102255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.109239] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.109412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.109494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.109803] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.109942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.110335] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.110335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.110490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.111341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.111341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.111341] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 is going to be updated. [ 791.137409] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.137650] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.137720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.137932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.138214] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.146063] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 in Status: IN_PROGRESS for 2s [ 791.421626] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-174 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.421891] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.422263] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.422561] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.423480] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.423480] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.423480] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.423704] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.424330] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.424330] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.424330] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.424330] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.424589] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.424589] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.424768] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.424894] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.437112] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.437314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.437314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.437505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.437663] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.437780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.437868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.438035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.438136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.438235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.438383] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.438476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.438540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.438683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.438837] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.439022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.439107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.439235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.439313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.439391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.439483] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.443273] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.443273] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 791.443273] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.444176] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.444176] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-517cb987-523c-4609-99ba-7ac49c0f6b14 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.444176] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-517cb987-523c-4609-99ba-7ac49c0f6b14" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.444176] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-517cb987-523c-4609-99ba-7ac49c0f6b14" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.444550] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-517cb987-523c-4609-99ba-7ac49c0f6b14" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.444716] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('517cb987-523c-4609-99ba-7ac49c0f6b14',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.682483] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 74s [ 791.734234] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: SUCCESS [ 791.734504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.734689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.736198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.736198] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.736198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.736198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.736198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.736198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.736198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.736198] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.736649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.736816] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.736981] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.737747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.737747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.737747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.737747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.737747] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.942731] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 327a22ab-0003-41d7-851d-6eba37a2b9dc: rpc.has_security_group_logging(os_id): False [ 791.947313] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.947532] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.947668] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.947954] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.948125] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.948296] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 517cb987-523c-4609-99ba-7ac49c0f6b14 not found, creating... [ 791.948591] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.948756] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.948874] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.950241] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.950428] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.951142] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.951370] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.951510] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.951735] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.951879] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.952266] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 517cb987-523c-4609-99ba-7ac49c0f6b14 is going to be created. [ 791.960372] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.960515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.960588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.960769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.960859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.961100] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.961623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.961623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.961623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.961623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.961907] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.961962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.961992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.962278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.962278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.962990] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.962990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.962990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.962990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.962990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.962990] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be updated. [ 791.971897] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.972154] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.972285] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.972627] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.972888] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.973134] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-517cb987-523c-4609-99ba-7ac49c0f6b14" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.036142] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.036340] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.036340] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.036556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.036696] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.059971] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 2s [ 792.239276] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.239467] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.239599] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.742405] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.876787] env[68109]: INFO networking_nsxv3.common.synchronization [req-1f57bc26-1121-4153-a47b-08ea3a7a0624 req-a8e58676-d4d4-45e5-b4ef-c728314604df service nova] Enqueued Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_rules [ 792.876972] env[68109]: INFO networking_nsxv3.common.synchronization [req-1f57bc26-1121-4153-a47b-08ea3a7a0624 req-a8e58676-d4d4-45e5-b4ef-c728314604df service nova] Enqueued Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 792.877129] env[68109]: INFO networking_nsxv3.common.synchronization [req-1f57bc26-1121-4153-a47b-08ea3a7a0624 req-a8e58676-d4d4-45e5-b4ef-c728314604df service nova] Enqueued Resource ID: 517cb987-523c-4609-99ba-7ac49c0f6b14 with Priority: HIGHEST for action port [ 792.877364] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_rules [ 792.877495] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 792.877594] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 517cb987-523c-4609-99ba-7ac49c0f6b14 with Priority: HIGHEST for action port [ 792.880858] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.880858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.880858] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.880858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.880858] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-517cb987-523c-4609-99ba-7ac49c0f6b14 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.880858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-517cb987-523c-4609-99ba-7ac49c0f6b14" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.880858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-517cb987-523c-4609-99ba-7ac49c0f6b14" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.880858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-517cb987-523c-4609-99ba-7ac49c0f6b14" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.880858] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('517cb987-523c-4609-99ba-7ac49c0f6b14',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.160195] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 in Status: SUCCESS [ 793.160494] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 deletion is rescheduled due to dependency. [ 793.160494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.245375] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.245553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.245805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.245914] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.245975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.246111] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 is going to be updated. [ 793.272691] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.272900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.272900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.273154] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.273306] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.281228] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: IN_PROGRESS for 2s [ 793.382029] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 517cb987-523c-4609-99ba-7ac49c0f6b14 with status ACTIVE [ 793.382250] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.382458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.382518] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.382760] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.382871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.383216] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.383216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.383443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.383520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.383589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.383747] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.383864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.384036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.384344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.384344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.384485] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 517cb987-523c-4609-99ba-7ac49c0f6b14 is going to be updated. [ 793.407988] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.408278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.408332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.408618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.408901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.409062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-517cb987-523c-4609-99ba-7ac49c0f6b14" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.694134] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: IN_PROGRESS for 76s [ 793.858401] env[68109]: INFO networking_nsxv3.common.synchronization [req-3532a543-6d65-4f2a-a671-c66b5dcf6a6f req-699998ec-b381-4489-8aca-050c79e0f197 tempest-ListServerFiltersTestJSON-53590806 tempest-ListServerFiltersTestJSON-53590806-project-member] Enqueued Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 793.858926] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 793.859255] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.859358] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.071979] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 794.072278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.290911] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-174 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.290911] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.290911] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.291333] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.291333] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.291566] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.291700] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.291917] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.292207] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.292442] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.292562] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.292675] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.292786] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.292897] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.293008] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.293148] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.310292] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.310463] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 794.310617] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.310804] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-174" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.311101] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-a63550b5-cf3b-4347-b862-116ab2ae9d37 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.311266] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-a63550b5-cf3b-4347-b862-116ab2ae9d37" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.311386] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-a63550b5-cf3b-4347-b862-116ab2ae9d37" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.311688] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-a63550b5-cf3b-4347-b862-116ab2ae9d37" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.311833] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a63550b5-cf3b-4347-b862-116ab2ae9d37',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.814473] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.814714] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.814866] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.815189] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.815579] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.815664] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port a63550b5-cf3b-4347-b862-116ab2ae9d37 not found, creating... [ 794.815983] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.816243] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.816405] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.816659] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.816806] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.818048] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.818248] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.818372] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.818617] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.819170] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.819357] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: a63550b5-cf3b-4347-b862-116ab2ae9d37 is going to be created. [ 794.837995] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.838232] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.838359] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.838636] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.838861] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.839096] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-a63550b5-cf3b-4347-b862-116ab2ae9d37" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.292410] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: SUCCESS [ 795.292657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.295596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.295596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.295596] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.295596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.295596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.295596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.295596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.295596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.295596] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.295596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.295596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.295596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.295596] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.295596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.295596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.295596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.296353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.296353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.296353] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.296738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.296901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.297225] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.297362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.297500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.297661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.297762] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.297856] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.540977] env[68109]: INFO networking_nsxv3.common.synchronization [req-3532a543-6d65-4f2a-a671-c66b5dcf6a6f req-6e99183f-c797-40db-b3f5-dbdd373c9c43 service nova] Enqueued Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_rules [ 795.540977] env[68109]: INFO networking_nsxv3.common.synchronization [req-3532a543-6d65-4f2a-a671-c66b5dcf6a6f req-6e99183f-c797-40db-b3f5-dbdd373c9c43 service nova] Enqueued Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 795.540977] env[68109]: INFO networking_nsxv3.common.synchronization [req-3532a543-6d65-4f2a-a671-c66b5dcf6a6f req-6e99183f-c797-40db-b3f5-dbdd373c9c43 service nova] Enqueued Resource ID: a63550b5-cf3b-4347-b862-116ab2ae9d37 with Priority: HIGHEST for action port [ 795.541228] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_rules [ 795.541438] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 795.541554] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a63550b5-cf3b-4347-b862-116ab2ae9d37 with Priority: HIGHEST for action port [ 795.542128] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.542232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.542424] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.542509] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.542691] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-a63550b5-cf3b-4347-b862-116ab2ae9d37 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.542800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a63550b5-cf3b-4347-b862-116ab2ae9d37" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.542866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a63550b5-cf3b-4347-b862-116ab2ae9d37" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.543095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a63550b5-cf3b-4347-b862-116ab2ae9d37" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.543213] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a63550b5-cf3b-4347-b862-116ab2ae9d37',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.707069] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9353334a-e1b0-43d9-9c87-a08b8516326e in Status: SUCCESS [ 795.707349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.800164] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbc22896-640c-4f05-bfd9-6290e8092bb2: rpc.has_security_group_logging(os_id): False [ 795.801958] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.818427] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.818427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.818427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.818427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.818658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.818750] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.818802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.818872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.819033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.819114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.819301] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.819397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.819459] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.819600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.819675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.819849] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.819973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.820090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.820260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.820338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.820426] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 is going to be created. [ 795.876324] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.876484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.876565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.876777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.876958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.888416] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: IN_PROGRESS for 2s [ 796.045134] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a63550b5-cf3b-4347-b862-116ab2ae9d37 with status ACTIVE [ 796.045381] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.045546] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.047845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.047845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.047845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.047845] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.047845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.047845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.047845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.047845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.047845] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.047845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.047845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.047845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.047845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.047845] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a63550b5-cf3b-4347-b862-116ab2ae9d37 is going to be updated. [ 796.069292] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.069437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.069508] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.069727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.069940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.070304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a63550b5-cf3b-4347-b862-116ab2ae9d37" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.305437] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.810305] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.810305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.810305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.810305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.810305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.810305] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 is going to be updated. [ 796.839125] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.839304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.839385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.839662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.839840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.849375] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: IN_PROGRESS for 2s [ 797.900023] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: SUCCESS [ 797.900375] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.900493] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.900721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.900811] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.403999] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.404597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.859294] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: SUCCESS [ 798.859513] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.859720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.859956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.860166] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.860281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.860369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.860529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.860691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.860744] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.031547] env[68109]: INFO networking_nsxv3.common.synchronization [req-266a2922-90b4-4c78-bdd1-395c13d784cc req-ffd739d6-446d-4c25-971e-3df8e1b00474 tempest-MultipleCreateTestJSON-181458045 tempest-MultipleCreateTestJSON-181458045-project-member] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 799.032102] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 799.032405] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.032554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.032654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.032816] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.032965] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.036901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.037024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.037234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.037331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.037436] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.364955] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.540236] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.871444] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.042041] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.087479] env[68109]: INFO networking_nsxv3.common.synchronization [req-eb042b1f-201d-4f0f-91dc-e60eebc2d758 req-dccfcc6a-2a77-4130-a073-830c27c705bc tempest-MultipleCreateTestJSON-181458045 tempest-MultipleCreateTestJSON-181458045-project-member] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 800.088216] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 800.091325] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.091325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.201595] env[68109]: INFO networking_nsxv3.common.synchronization [req-d63948f9-f95e-458e-82d5-af36c141d112 req-f9f6109a-e38c-4534-a5eb-b9d9ee724f4c tempest-ListServersNegativeTestJSON-1715359508 tempest-ListServersNegativeTestJSON-1715359508-project-member] Enqueued Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 800.206077] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 800.206077] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.206077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.206077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.206077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.206077] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.206077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.206077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.206077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.206077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.206077] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.373522] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.373725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.373855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.374042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.374136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.374236] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 is going to be updated. [ 800.404109] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.404308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.404452] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.404643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.404859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.413842] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: IN_PROGRESS for 2s [ 800.516839] env[68109]: INFO networking_nsxv3.common.synchronization [req-9fa9a142-c494-4b7e-bbeb-e55840086fdd req-5030893c-35e8-4d21-a612-65e15ca597fc tempest-ListServersNegativeTestJSON-1715359508 tempest-ListServersNegativeTestJSON-1715359508-project-member] Enqueued Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 800.517564] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 with Priority: HIGHEST for action security_group_members [ 800.517784] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe094fad-6ec3-4179-88a0-da40e49c0ff5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.517891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.547847] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.548021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.548091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.548270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.548373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.548657] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be updated. [ 800.579066] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.579259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.579347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.579638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.579769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.588235] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 2s [ 800.708744] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.989787] env[68109]: INFO networking_nsxv3.common.synchronization [req-b614d32f-9d3b-4635-86b8-713b8033e8e2 req-b15bd726-74f2-431f-a407-56265175bf06 tempest-InstanceActionsV221TestJSON-913445079 tempest-InstanceActionsV221TestJSON-913445079-project-member] Enqueued Resource ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b with Priority: HIGHEST for action security_group_members [ 800.991957] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b with Priority: HIGHEST for action security_group_members [ 800.992740] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-58813947-23b6-4e9d-aed6-9b1d65b5728b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.992961] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.993094] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.993504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.993733] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.993971] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.993971] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.994165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.994905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.995115] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58813947-23b6-4e9d-aed6-9b1d65b5728b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.212427] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.311874] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-487 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.312088] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-487" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.313139] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-487" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.313139] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-487" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.313842] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.314076] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.314229] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.314513] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.314832] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.314945] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.315107] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.315281] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.315401] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.315522] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.315652] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.315809] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.335379] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.335590] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.335769] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.335974] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-487" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.336294] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-3779858e-c444-4a72-9d4d-ffe6ab398d4f taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.336467] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-3779858e-c444-4a72-9d4d-ffe6ab398d4f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.336588] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-3779858e-c444-4a72-9d4d-ffe6ab398d4f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.337205] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-3779858e-c444-4a72-9d4d-ffe6ab398d4f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.337460] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3779858e-c444-4a72-9d4d-ffe6ab398d4f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.498419] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.498419] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.498633] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.498839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.499022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.499309] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.499498] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.499831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.499961] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.499997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.500138] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b already deleted. [ 801.500291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.716265] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.716265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.716265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.716265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.716265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.716265] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 is going to be updated. [ 801.753404] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.753616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.753616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.754176] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.754176] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.762631] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: IN_PROGRESS for 2s [ 801.842081] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.842332] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.842461] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.842776] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.842929] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.843097] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 3779858e-c444-4a72-9d4d-ffe6ab398d4f not found, creating... [ 801.843356] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.843529] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.843645] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.843865] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.843998] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.844289] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.844441] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.844564] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.844766] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.844898] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.845089] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 3779858e-c444-4a72-9d4d-ffe6ab398d4f is going to be created. [ 801.865856] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.866043] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.866176] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.866443] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.866670] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.866893] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-3779858e-c444-4a72-9d4d-ffe6ab398d4f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.211395] env[68109]: INFO networking_nsxv3.common.synchronization [None req-290b427b-bf41-4861-aa44-834dda105d84 None None] Enqueued Resource ID: 2a5286e5-e9a7-423a-84a3-2f2fc515c692 with Priority: HIGHEST for action port [ 802.211650] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a5286e5-e9a7-423a-84a3-2f2fc515c692 with Priority: HIGHEST for action port [ 802.212239] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a5286e5-e9a7-423a-84a3-2f2fc515c692 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.212387] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a5286e5-e9a7-423a-84a3-2f2fc515c692" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.212473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a5286e5-e9a7-423a-84a3-2f2fc515c692" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.212755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a5286e5-e9a7-423a-84a3-2f2fc515c692" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.212826] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a5286e5-e9a7-423a-84a3-2f2fc515c692',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.423977] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: SUCCESS [ 802.423977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.423977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.423977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.423977] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.423977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.423977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.423977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.423977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.424291] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.565886] env[68109]: INFO networking_nsxv3.common.synchronization [req-b614d32f-9d3b-4635-86b8-713b8033e8e2 req-b94fd22d-0f25-46a5-9186-c9d7e025b0ae service nova] Enqueued Resource ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b with Priority: HIGHEST for action security_group_rules [ 802.566055] env[68109]: INFO networking_nsxv3.common.synchronization [req-b614d32f-9d3b-4635-86b8-713b8033e8e2 req-b94fd22d-0f25-46a5-9186-c9d7e025b0ae service nova] Enqueued Resource ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b with Priority: HIGHEST for action security_group_members [ 802.566156] env[68109]: INFO networking_nsxv3.common.synchronization [req-b614d32f-9d3b-4635-86b8-713b8033e8e2 req-b94fd22d-0f25-46a5-9186-c9d7e025b0ae service nova] Enqueued Resource ID: 3779858e-c444-4a72-9d4d-ffe6ab398d4f with Priority: HIGHEST for action port [ 802.566674] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b with Priority: HIGHEST for action security_group_rules [ 802.566804] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b with Priority: HIGHEST for action security_group_members [ 802.566900] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3779858e-c444-4a72-9d4d-ffe6ab398d4f with Priority: HIGHEST for action port [ 802.567184] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58813947-23b6-4e9d-aed6-9b1d65b5728b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.567305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.567373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.567636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.567734] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58813947-23b6-4e9d-aed6-9b1d65b5728b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.568529] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-58813947-23b6-4e9d-aed6-9b1d65b5728b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.572019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.572019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.572019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.572019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.572019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.572019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.572019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.572019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.572019] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58813947-23b6-4e9d-aed6-9b1d65b5728b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.572019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-3779858e-c444-4a72-9d4d-ffe6ab398d4f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.572019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3779858e-c444-4a72-9d4d-ffe6ab398d4f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.572019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3779858e-c444-4a72-9d4d-ffe6ab398d4f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.572019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3779858e-c444-4a72-9d4d-ffe6ab398d4f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.572019] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3779858e-c444-4a72-9d4d-ffe6ab398d4f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.597394] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 4s [ 802.704758] env[68109]: INFO networking_nsxv3.common.synchronization [None req-810a4ec2-370b-4acb-83f1-cf015076bcb6 tempest-ServersV294TestFqdnHostnames-578105793 tempest-ServersV294TestFqdnHostnames-578105793-project-member] Enqueued Resource ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 with Priority: HIGHEST for action security_group_rules [ 802.705219] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 with Priority: HIGHEST for action security_group_rules [ 802.705510] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f244466-a6a8-4118-96a9-bf22e5d33c96 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.705624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.705687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.706090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.706090] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f244466-a6a8-4118-96a9-bf22e5d33c96',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.714256] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a5286e5-e9a7-423a-84a3-2f2fc515c692 [ 802.714452] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.714598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.714666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.714855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.714937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.716021] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a5286e5-e9a7-423a-84a3-2f2fc515c692 already deleted. [ 802.716142] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a5286e5-e9a7-423a-84a3-2f2fc515c692" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.821114] env[68109]: INFO networking_nsxv3.common.synchronization [None req-74b83f93-251f-4949-9779-8bdec3469502 tempest-ServersV294TestFqdnHostnames-578105793 tempest-ServersV294TestFqdnHostnames-578105793-project-member] Enqueued Resource ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 with Priority: HIGHEST for action security_group_rules [ 802.821635] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 with Priority: HIGHEST for action security_group_rules [ 802.821943] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f244466-a6a8-4118-96a9-bf22e5d33c96 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.822615] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.929568] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.073019] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58813947-23b6-4e9d-aed6-9b1d65b5728b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.073431] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-58813947-23b6-4e9d-aed6-9b1d65b5728b taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.073627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.073946] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3779858e-c444-4a72-9d4d-ffe6ab398d4f with status ACTIVE [ 803.074118] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.074222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.074651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.074892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.074991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.075179] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.075275] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.075333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.075485] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.075558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.075730] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.075837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.075915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.076072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.076145] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.076225] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3779858e-c444-4a72-9d4d-ffe6ab398d4f is going to be updated. [ 803.097947] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.097947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.097947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.097947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.097947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.097947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3779858e-c444-4a72-9d4d-ffe6ab398d4f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.229309] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.229684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.229684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.229684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.229806] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.229806] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 already deleted. [ 803.229966] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.230424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.230588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.230788] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f244466-a6a8-4118-96a9-bf22e5d33c96',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.432094] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.575243] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58813947-23b6-4e9d-aed6-9b1d65b5728b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.750816] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.750958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.751033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.751413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.751413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.751413] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 already deleted. [ 803.751574] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.771841] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: SUCCESS [ 803.772081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.772848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.772848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.772848] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.772848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.772848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.773088] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.773088] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.773145] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe094fad-6ec3-4179-88a0-da40e49c0ff5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.863334] env[68109]: INFO networking_nsxv3.common.synchronization [req-2e5b16da-93f0-4a9a-a157-5eed65790cda req-b7d99709-03ff-4da6-ae17-47e59000c086 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 803.863906] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 803.864219] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.864344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.864411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.864629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.864744] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.864846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.865771] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.866699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.866699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.866699] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.937714] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.937714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.937714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.937714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.937714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.937714] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 is going to be updated. [ 803.968342] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.968342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.968342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.968342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.968342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.975626] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: IN_PROGRESS for 2s [ 804.080287] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.080287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.080287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.080287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.080287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.080287] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b is going to be created. [ 804.107486] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.107486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.107486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.107645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.108486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.120533] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b in Status: UNINITIALIZED for 2s [ 804.248127] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.248597] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-134" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.248597] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-134" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.248597] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-134" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.248933] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.249021] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.249099] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.249309] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.249453] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.249661] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.249774] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.249885] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.249993] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.250117] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.250226] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.250357] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.267359] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.267519] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 804.267881] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.268097] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-134" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.268408] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-e64768a9-133d-49fd-afca-b064042bbc21 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.268642] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.268698] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.268980] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.269155] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64768a9-133d-49fd-afca-b064042bbc21',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.277038] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.277164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.277236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.277413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.277503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.277674] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.277770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.277827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.277967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.278060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.278146] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 is going to be updated. [ 804.301943] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.302078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.302123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.302316] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.302452] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.311257] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: IN_PROGRESS for 2s [ 804.372660] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.486236] env[68109]: INFO networking_nsxv3.common.synchronization [None req-a0607151-b9c4-4407-8bf2-01abc3e54b46 None None] Enqueued Resource ID: 5af27b3f-3096-4e46-82b5-569ca2b6f3eb with Priority: HIGHEST for action port [ 804.486236] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5af27b3f-3096-4e46-82b5-569ca2b6f3eb with Priority: HIGHEST for action port [ 804.486236] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-5af27b3f-3096-4e46-82b5-569ca2b6f3eb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.486236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5af27b3f-3096-4e46-82b5-569ca2b6f3eb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.486236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5af27b3f-3096-4e46-82b5-569ca2b6f3eb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.486236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5af27b3f-3096-4e46-82b5-569ca2b6f3eb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.486236] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5af27b3f-3096-4e46-82b5-569ca2b6f3eb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.610086] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 804.610086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.610086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.610086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.610321] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.610500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.610500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.610673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.610673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.610781] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.639189] env[68109]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] NSXv3 Agent Agent loop - iteration:0 completed [ 804.639699] env[68109]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] NSXv3 Agent Agent loop - iteration:1 started [ 804.771380] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.771597] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.771724] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.772016] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.772204] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.772352] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port e64768a9-133d-49fd-afca-b064042bbc21 not found, creating... [ 804.772601] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.772775] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.772892] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.773182] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.773250] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.773556] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.773735] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.773854] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.774065] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.774197] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.774333] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: e64768a9-133d-49fd-afca-b064042bbc21 is going to be created. [ 804.798903] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.799200] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.799363] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.799665] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.799945] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.800224] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.876064] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.989190] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5af27b3f-3096-4e46-82b5-569ca2b6f3eb [ 804.989190] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.990035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.990035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.990035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.990035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.990035] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5af27b3f-3096-4e46-82b5-569ca2b6f3eb already deleted. [ 804.990260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5af27b3f-3096-4e46-82b5-569ca2b6f3eb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.113875] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.114107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.114168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.114356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.114447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.114678] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.114792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.114846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.114989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.115069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.115134] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be updated. [ 805.144285] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.144519] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.144615] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.144781] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.144931] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.154137] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 2s [ 805.379811] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.380113] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.380113] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.380346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.380469] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.380608] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 805.427785] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.427785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.427785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.427785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.427785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.435092] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 805.669301] env[68109]: INFO networking_nsxv3.common.synchronization [req-2e5b16da-93f0-4a9a-a157-5eed65790cda req-dfe772d3-01c4-4063-86fe-80a88b9bd5e1 service nova] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_rules [ 805.669494] env[68109]: INFO networking_nsxv3.common.synchronization [req-2e5b16da-93f0-4a9a-a157-5eed65790cda req-dfe772d3-01c4-4063-86fe-80a88b9bd5e1 service nova] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 805.669635] env[68109]: INFO networking_nsxv3.common.synchronization [req-2e5b16da-93f0-4a9a-a157-5eed65790cda req-dfe772d3-01c4-4063-86fe-80a88b9bd5e1 service nova] Enqueued Resource ID: e64768a9-133d-49fd-afca-b064042bbc21 with Priority: HIGHEST for action port [ 805.669936] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_rules [ 805.670120] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 805.670228] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64768a9-133d-49fd-afca-b064042bbc21 with Priority: HIGHEST for action port [ 805.671367] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.671500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.671587] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.671805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.671891] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.674128] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.674128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.674128] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-e64768a9-133d-49fd-afca-b064042bbc21 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.674128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.674128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.674128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.674128] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64768a9-133d-49fd-afca-b064042bbc21',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.985637] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: SUCCESS [ 805.985859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.986108] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.986264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.986450] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.986570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.986636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.986786] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.986869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.986955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.987074] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.134227] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b in Status: SUCCESS [ 806.136679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.136679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.136679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.136679] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.136679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.136679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.136679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.136679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.136679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.136679] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58813947-23b6-4e9d-aed6-9b1d65b5728b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.175070] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.175263] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.175594] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e64768a9-133d-49fd-afca-b064042bbc21 with status ACTIVE [ 806.176220] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.176220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.176220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.176220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.176637] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.176637] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.176637] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.176758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.176936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.177024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.177200] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.177293] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.177360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.177503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.177629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.177662] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e64768a9-133d-49fd-afca-b064042bbc21 is going to be updated. [ 806.198417] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.198623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.198623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.198828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.198964] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.199180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.322013] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 in Status: SUCCESS [ 806.322280] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe094fad-6ec3-4179-88a0-da40e49c0ff5 deletion is rescheduled due to dependency. [ 806.322353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe094fad-6ec3-4179-88a0-da40e49c0ff5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.490240] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.490541] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.490541] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.490772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.490992] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.491120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.491162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.491324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.491432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.491591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.491752] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.491846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.491907] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.492085] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.492200] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.493213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.493416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.493476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.493567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.493667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.493788] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.638680] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-58813947-23b6-4e9d-aed6-9b1d65b5728b taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.640338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.640338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.640338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.640532] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.640626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.640672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.640826] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.640912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.641010] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.641212] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-58813947-23b6-4e9d-aed6-9b1d65b5728b taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.641309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.641309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.642494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.642494] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.642494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.642494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.642494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.642494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.642494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.642494] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58813947-23b6-4e9d-aed6-9b1d65b5728b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.996186] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbc22896-640c-4f05-bfd9-6290e8092bb2: rpc.has_security_group_logging(os_id): False [ 807.014659] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.014883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.014949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.015129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.015239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.015458] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.015559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.015623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.015780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.015858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.016147] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.016147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.016226] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.016336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.016411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.016589] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.016727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.016727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.016891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.016969] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.017803] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 is going to be updated. [ 807.083063] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.083289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.083369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.083609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.083786] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.098220] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: IN_PROGRESS for 2s [ 807.148777] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58813947-23b6-4e9d-aed6-9b1d65b5728b: rpc.has_security_group_logging(os_id): False [ 807.167608] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 807.167784] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc deletion is rescheduled due to dependency. [ 807.168102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.171606] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.171772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.171845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.172078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.172169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.172361] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.172461] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.172524] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.172676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.172752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.172966] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.173911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.173911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.173911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.173911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.173911] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.173911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.173911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.173911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.173911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.174202] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b is going to be created. [ 807.261208] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.261208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.261208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.261208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.261208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.273826] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b in Status: IN_PROGRESS for 2s [ 807.446916] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 807.447185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.447414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.447668] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.448095] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.448095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.448243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.448376] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.448461] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.448624] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.951678] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.453977] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.733055] env[68109]: INFO networking_nsxv3.common.synchronization [req-7af16ccb-e399-4343-a801-cc6886689cf8 req-0ef93336-fb61-47ed-92fc-9dbc86b252b7 tempest-ServerRescueNegativeTestJSON-575486598 tempest-ServerRescueNegativeTestJSON-575486598-project-member] Enqueued Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGHEST for action security_group_members [ 808.733628] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGHEST for action security_group_members [ 808.733953] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-747242aa-4753-441a-b06c-3f9a70ac6a6e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.734973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.735104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.735314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.735483] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.735591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.735653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.735815] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.735942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.736036] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('747242aa-4753-441a-b06c-3f9a70ac6a6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.960199] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.960876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.960876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.960876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.960876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.960876] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 808.993714] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.993714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.993714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.993714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.993714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.001051] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 809.111232] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: SUCCESS [ 809.111336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.111607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.111821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.111912] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.238186] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.240717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.240717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.240717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.240717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.240717] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.240717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.240717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.240717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.240717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.240717] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e already deleted. [ 809.240717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.286525] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b in Status: SUCCESS [ 809.288740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.315113] env[68109]: INFO networking_nsxv3.common.synchronization [req-762e75e3-def2-4ae3-bbdc-115d60555f5d req-cb881b8d-dc83-4ea0-a13a-ee7acb74fb76 tempest-ServersTestManualDisk-984063323 tempest-ServersTestManualDisk-984063323-project-member] Enqueued Resource ID: d2db7fe9-82f8-4d20-b269-363d052050b8 with Priority: HIGHEST for action security_group_members [ 809.316019] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2db7fe9-82f8-4d20-b269-363d052050b8 with Priority: HIGHEST for action security_group_members [ 809.316430] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2db7fe9-82f8-4d20-b269-363d052050b8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.316568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.316568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.316869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.317044] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.317193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.317240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.317377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.317463] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.317561] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2db7fe9-82f8-4d20-b269-363d052050b8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.404152] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-9 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.404354] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.404596] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.404910] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.405218] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.405381] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.405505] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.405738] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.405881] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.406116] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.406228] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.406338] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.406447] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.407672] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.407742] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.407859] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.428034] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.428175] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 809.429033] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.429033] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.429033] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-65cb1a0c-b485-4d91-8ec5-6457f842f641 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.429033] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-65cb1a0c-b485-4d91-8ec5-6457f842f641" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.429033] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-65cb1a0c-b485-4d91-8ec5-6457f842f641" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.429386] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-65cb1a0c-b485-4d91-8ec5-6457f842f641" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.429531] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65cb1a0c-b485-4d91-8ec5-6457f842f641',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.613954] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.614134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.614210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.614423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.618018] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.618018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.618018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.618018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.618018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.618018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.618018] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.820194] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.820391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.820430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.820740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.820865] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.821104] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.821236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.821307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.821516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.821687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.821743] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2db7fe9-82f8-4d20-b269-363d052050b8 is going to be updated. [ 809.846036] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.846205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.846270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.846472] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.846614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.854228] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2db7fe9-82f8-4d20-b269-363d052050b8 in Status: IN_PROGRESS for 2s [ 809.940167] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.940167] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.940167] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.940167] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.940167] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.940167] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 65cb1a0c-b485-4d91-8ec5-6457f842f641 not found, creating... [ 809.940167] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.940167] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.940167] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.940167] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.940167] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.940681] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.940681] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.940681] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.940681] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.940981] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.941287] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 65cb1a0c-b485-4d91-8ec5-6457f842f641 is going to be created. [ 809.966019] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.966019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.966019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.966019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.966019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.966019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-65cb1a0c-b485-4d91-8ec5-6457f842f641" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.118600] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.118600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.118600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.118600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.118845] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.118936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.119557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.119557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.119557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.119707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.119857] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.120111] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.120111] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.120312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.120517] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.120656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.120754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.121040] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.121369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.121575] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.121692] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.625987] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbc22896-640c-4f05-bfd9-6290e8092bb2: rpc.has_security_group_logging(os_id): False [ 810.651173] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.651173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.651173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.651173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.653753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.654149] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.654426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.654597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.654953] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.655598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.655934] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.656309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.656725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.657094] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.657244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.657524] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.658269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.658391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.658618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.658763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.660493] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 is going to be updated. [ 810.664971] env[68109]: INFO networking_nsxv3.common.synchronization [req-7af16ccb-e399-4343-a801-cc6886689cf8 req-9e142063-b770-4b42-a661-86fa22785712 service nova] Enqueued Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGHEST for action security_group_rules [ 810.665308] env[68109]: INFO networking_nsxv3.common.synchronization [req-7af16ccb-e399-4343-a801-cc6886689cf8 req-9e142063-b770-4b42-a661-86fa22785712 service nova] Enqueued Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGHEST for action security_group_members [ 810.665482] env[68109]: INFO networking_nsxv3.common.synchronization [req-7af16ccb-e399-4343-a801-cc6886689cf8 req-9e142063-b770-4b42-a661-86fa22785712 service nova] Enqueued Resource ID: 65cb1a0c-b485-4d91-8ec5-6457f842f641 with Priority: HIGHEST for action port [ 810.666030] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGHEST for action security_group_rules [ 810.666230] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGHEST for action security_group_members [ 810.666383] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65cb1a0c-b485-4d91-8ec5-6457f842f641 with Priority: HIGHEST for action port [ 810.666700] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-747242aa-4753-441a-b06c-3f9a70ac6a6e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.666873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.667013] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.667262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.667523] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('747242aa-4753-441a-b06c-3f9a70ac6a6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.668952] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-747242aa-4753-441a-b06c-3f9a70ac6a6e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.669155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.669341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.669647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.669851] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.669999] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.670578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.670578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.670578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.670578] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('747242aa-4753-441a-b06c-3f9a70ac6a6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.671689] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-65cb1a0c-b485-4d91-8ec5-6457f842f641 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.672184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65cb1a0c-b485-4d91-8ec5-6457f842f641" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.673143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65cb1a0c-b485-4d91-8ec5-6457f842f641" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.673143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65cb1a0c-b485-4d91-8ec5-6457f842f641" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.673143] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65cb1a0c-b485-4d91-8ec5-6457f842f641',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.742446] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.742446] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.742446] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.742641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.742774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.758300] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: IN_PROGRESS for 2s [ 811.011895] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 811.012154] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.012298] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.012580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.012816] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.012968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.013054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.013221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.013304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.013390] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.013484] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.170248] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-747242aa-4753-441a-b06c-3f9a70ac6a6e taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.170248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.175046] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('747242aa-4753-441a-b06c-3f9a70ac6a6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.176396] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65cb1a0c-b485-4d91-8ec5-6457f842f641 with status ACTIVE [ 811.176509] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.176604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.176654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.178093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.178093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.178093] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.178093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.178093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.178093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.178093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.178093] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.178093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.178093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.178093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.178093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.178093] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65cb1a0c-b485-4d91-8ec5-6457f842f641 is going to be updated. [ 811.202268] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.202268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.202268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.202268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.202268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.202268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65cb1a0c-b485-4d91-8ec5-6457f842f641" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.252111] env[68109]: INFO networking_nsxv3.common.synchronization [req-10bd62d2-12c2-456f-bdf0-cfb8744f4ad3 req-996c8fa9-3f08-4762-9ed5-cfd482a5a609 tempest-ServerDiskConfigTestJSON-1064584538 tempest-ServerDiskConfigTestJSON-1064584538-project-member] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 811.252111] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 811.253917] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.254072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.254141] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.254341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.254497] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.254590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.254651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.254796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.254883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.254968] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.516367] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.516535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.516639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.516901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.517099] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.517489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.517489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.517489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.517489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.517654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.518438] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.518438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.518438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.518438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.518438] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.518438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.518438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.518767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.518767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.518767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.518854] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.594964] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-332 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.595325] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.595597] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.596105] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.596610] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.596953] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.597194] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.597627] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.597888] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.598259] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 811.598439] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 811.598719] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 811.598945] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 811.599158] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 811.599347] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 811.599672] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 811.619905] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 811.620105] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 811.620253] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 811.620470] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.620812] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-e1a2d912-e9e5-4b37-aed8-4427b2d9812f taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.620994] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-e1a2d912-e9e5-4b37-aed8-4427b2d9812f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.621124] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-e1a2d912-e9e5-4b37-aed8-4427b2d9812f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.621530] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-e1a2d912-e9e5-4b37-aed8-4427b2d9812f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.621701] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1a2d912-e9e5-4b37-aed8-4427b2d9812f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.676529] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('747242aa-4753-441a-b06c-3f9a70ac6a6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.762271] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.762271] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.762271] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.762271] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.762271] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.762271] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.762627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.762627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.762627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.762627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.762736] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 811.800919] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.801100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.801183] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.801389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.801565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.815138] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 811.863743] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2db7fe9-82f8-4d20-b269-363d052050b8 in Status: SUCCESS [ 811.863743] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2db7fe9-82f8-4d20-b269-363d052050b8 deletion is rescheduled due to dependency. [ 811.863743] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2db7fe9-82f8-4d20-b269-363d052050b8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.021092] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a8ad551-9243-4b5e-a0bd-acf823c5b01f: rpc.has_security_group_logging(os_id): False [ 812.037938] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.038160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.038229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.038436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.038527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.038745] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.038847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.038905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.039081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.039173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.039395] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.039494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.039559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.039714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.039809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.040509] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.040617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.040656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.040784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.040858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.041131] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 812.096896] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.097065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.097117] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.097331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.097515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.111299] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 812.124653] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.124979] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.125194] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.125487] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.125763] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.125945] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port e1a2d912-e9e5-4b37-aed8-4427b2d9812f not found, creating... [ 812.126247] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.126434] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.126539] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.126850] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.126996] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.127409] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.127596] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.127690] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.127914] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.128076] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.128491] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: e1a2d912-e9e5-4b37-aed8-4427b2d9812f is going to be created. [ 812.160793] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.161032] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.161163] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.161445] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.161718] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.161947] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-e1a2d912-e9e5-4b37-aed8-4427b2d9812f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.178234] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.178383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.178462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.178648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.178736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.178858] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e is going to be created. [ 812.208867] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.209072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.209167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.209390] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.209568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.218878] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e in Status: UNINITIALIZED for 2s [ 812.773450] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: SUCCESS [ 812.774534] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.868278] env[68109]: INFO networking_nsxv3.common.synchronization [req-10bd62d2-12c2-456f-bdf0-cfb8744f4ad3 req-166d9e8d-5aca-4cd9-ac54-4ad90a842ea5 service nova] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_rules [ 812.868642] env[68109]: INFO networking_nsxv3.common.synchronization [req-10bd62d2-12c2-456f-bdf0-cfb8744f4ad3 req-166d9e8d-5aca-4cd9-ac54-4ad90a842ea5 service nova] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 812.868914] env[68109]: INFO networking_nsxv3.common.synchronization [req-10bd62d2-12c2-456f-bdf0-cfb8744f4ad3 req-166d9e8d-5aca-4cd9-ac54-4ad90a842ea5 service nova] Enqueued Resource ID: e1a2d912-e9e5-4b37-aed8-4427b2d9812f with Priority: HIGHEST for action port [ 812.872562] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_rules [ 812.873783] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 812.873783] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1a2d912-e9e5-4b37-aed8-4427b2d9812f with Priority: HIGHEST for action port [ 812.873783] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.873783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.873783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.873783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.873783] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.874609] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.874750] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.876473] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1a2d912-e9e5-4b37-aed8-4427b2d9812f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.876634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1a2d912-e9e5-4b37-aed8-4427b2d9812f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.876746] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1a2d912-e9e5-4b37-aed8-4427b2d9812f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.877260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1a2d912-e9e5-4b37-aed8-4427b2d9812f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.877260] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1a2d912-e9e5-4b37-aed8-4427b2d9812f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.379534] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.379865] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.381382] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1a2d912-e9e5-4b37-aed8-4427b2d9812f with status ACTIVE [ 813.381382] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.381506] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.381506] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.381829] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.381919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.381919] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.381919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.381919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.381919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.381919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.383213] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.383213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.383213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.383213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.383213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.383213] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1a2d912-e9e5-4b37-aed8-4427b2d9812f is going to be updated. [ 813.404579] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.404804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.404979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.405704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.405704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.405704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1a2d912-e9e5-4b37-aed8-4427b2d9812f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.825083] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 813.825326] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 deletion is rescheduled due to dependency. [ 813.825392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.825564] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.825787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.826015] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.826146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.826213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.826385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.826470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.826683] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.124612] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 814.124780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.228035] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e in Status: SUCCESS [ 814.228172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.228347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.229167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.229167] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.229167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.229167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.229167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.229167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.229430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.229430] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('747242aa-4753-441a-b06c-3f9a70ac6a6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.328896] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.614802] env[68109]: INFO networking_nsxv3.common.synchronization [req-4bf06d70-28c0-4feb-9a38-ea31f4b9b128 req-e7c1b193-9ae6-4fda-9495-29223ff0c6a6 tempest-InstanceActionsV221TestJSON-913445079 tempest-InstanceActionsV221TestJSON-913445079-project-member] Enqueued Resource ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b with Priority: HIGHEST for action security_group_members [ 814.615579] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b with Priority: HIGHEST for action security_group_members [ 814.615953] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-58813947-23b6-4e9d-aed6-9b1d65b5728b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.616143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.616214] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.616489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.616866] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.616866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.617055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.617089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.617259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.617378] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58813947-23b6-4e9d-aed6-9b1d65b5728b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.731953] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('747242aa-4753-441a-b06c-3f9a70ac6a6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.832575] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.119511] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.120645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.120645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.120645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.120645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.120645] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.120645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.121166] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.121909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.122203] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.122442] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b is going to be updated. [ 815.149416] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.149617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.149715] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.149943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.150322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.158376] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b in Status: IN_PROGRESS for 2s [ 815.236924] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 747242aa-4753-441a-b06c-3f9a70ac6a6e: rpc.has_security_group_logging(os_id): False [ 815.257018] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.257217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.257321] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.257566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.257697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.257978] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.258120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.258208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.258401] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.259031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.259031] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e is going to be created. [ 815.319775] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.319935] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.320017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.320238] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.320420] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.331378] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e in Status: IN_PROGRESS for 2s [ 815.336755] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.336755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.336755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.336755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.336755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.336755] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 815.376213] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.376366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.376463] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.376726] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.376844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.387173] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 815.993854] env[68109]: INFO networking_nsxv3.common.synchronization [req-a26b9615-cd71-457d-9f26-b97cc903208d req-3d07c573-3af8-4688-9857-d58f7394f2c7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 815.994204] env[68109]: INFO networking_nsxv3.common.synchronization [req-a26b9615-cd71-457d-9f26-b97cc903208d req-3d07c573-3af8-4688-9857-d58f7394f2c7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGHEST for action security_group_members [ 815.994548] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 815.996221] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGHEST for action security_group_members [ 815.996221] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.996221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.996221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.996221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.996221] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.996221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.996221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.996221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.996221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.996221] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.997698] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76ac522-d413-411a-995f-1682c0fc160f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.997698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.997698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.997698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.997844] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.997916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.997974] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.998123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.998198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.998282] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.051767] env[68109]: INFO networking_nsxv3.common.synchronization [req-a26b9615-cd71-457d-9f26-b97cc903208d req-3d07c573-3af8-4688-9857-d58f7394f2c7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_rules [ 816.051947] env[68109]: INFO networking_nsxv3.common.synchronization [req-a26b9615-cd71-457d-9f26-b97cc903208d req-3d07c573-3af8-4688-9857-d58f7394f2c7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 816.052108] env[68109]: INFO networking_nsxv3.common.synchronization [req-a26b9615-cd71-457d-9f26-b97cc903208d req-3d07c573-3af8-4688-9857-d58f7394f2c7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGHEST for action security_group_rules [ 816.052242] env[68109]: INFO networking_nsxv3.common.synchronization [req-a26b9615-cd71-457d-9f26-b97cc903208d req-3d07c573-3af8-4688-9857-d58f7394f2c7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGHEST for action security_group_members [ 816.052369] env[68109]: INFO networking_nsxv3.common.synchronization [req-a26b9615-cd71-457d-9f26-b97cc903208d req-3d07c573-3af8-4688-9857-d58f7394f2c7 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: e64768a9-133d-49fd-afca-b064042bbc21 with Priority: HIGHEST for action port [ 816.052842] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_rules [ 816.052979] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGHEST for action security_group_rules [ 816.053297] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64768a9-133d-49fd-afca-b064042bbc21 with Priority: HIGHEST for action port [ 816.053419] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 816.053514] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGHEST for action security_group_members [ 816.053814] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.053938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.054009] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.054212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.054287] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.055526] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76ac522-d413-411a-995f-1682c0fc160f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.055741] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.055836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.056061] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.056142] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.057200] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-e64768a9-133d-49fd-afca-b064042bbc21 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.057298] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.057366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.057519] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.057594] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64768a9-133d-49fd-afca-b064042bbc21',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.058725] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.058814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.058999] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76ac522-d413-411a-995f-1682c0fc160f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.059094] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.500518] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.501399] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.559463] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.559600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.559820] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76ac522-d413-411a-995f-1682c0fc160f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.559899] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.560111] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e64768a9-133d-49fd-afca-b064042bbc21 with status ACTIVE [ 816.560209] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.560895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.560895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.560895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.560895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.560895] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.560895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.561249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.561249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.561249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.561376] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.561444] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.561503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.561642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.561714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.561803] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e64768a9-133d-49fd-afca-b064042bbc21 is going to be updated. [ 816.582010] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.582164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.582237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.582418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.582649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.582753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.003095] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.004202] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.169510] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b in Status: SUCCESS [ 817.169510] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b deletion is rescheduled due to dependency. [ 817.169510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.344107] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e in Status: SUCCESS [ 817.344107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.398790] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 817.400140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.400140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.400140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.400140] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.400140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.400140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.400140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.400140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.400590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.400590] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.506116] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.506325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.506370] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.506591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.506707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.506815] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76ac522-d413-411a-995f-1682c0fc160f is going to be created. [ 817.508219] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.508353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.508434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.508579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.508663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.508755] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 817.533962] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.534209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.534209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.534386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.534554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.536493] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.536648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.536714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.536868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.537029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.546877] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 817.547621] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76ac522-d413-411a-995f-1682c0fc160f in Status: UNINITIALIZED for 2s [ 817.903548] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.903851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.903956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.904300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.904531] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.904679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.904875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.905102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.905222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.905345] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.905562] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.905711] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.905776] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.905925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.906083] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.906185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.906249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.906370] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.906445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.906512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.906606] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.409141] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7eff74c-b690-47ef-ba84-9ec9d2765c99: rpc.has_security_group_logging(os_id): False [ 818.434138] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.434287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.434357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.434574] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.434686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.434916] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.434993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.435066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.435215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.435291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.435499] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.435593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.435654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.435792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.435865] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.437085] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.437281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.437380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.439334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.439679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.439679] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 818.525173] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.525173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.525173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.525364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.525450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.542042] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 819.558107] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 819.558415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.558549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.558767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.558973] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.559120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.559206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.559345] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.559435] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.559545] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.561466] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76ac522-d413-411a-995f-1682c0fc160f in Status: SUCCESS [ 819.561685] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.561837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.562011] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.562186] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.562287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.563085] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.563085] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.563085] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.563085] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.066424] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.067778] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.456729] env[68109]: INFO networking_nsxv3.common.synchronization [req-42d38353-bd3a-4778-ae19-0fbfea7133b3 req-03fa578a-be5d-4e5d-b3f3-b603bb2e6825 tempest-DeleteServersTestJSON-2063667557 tempest-DeleteServersTestJSON-2063667557-project-member] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 820.457317] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 820.457619] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.461017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.461017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.461017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.461017] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.461017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.461017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.461017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.461017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.461017] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.555305] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 820.556912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.573019] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.573019] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.584552] env[68109]: INFO networking_nsxv3.common.synchronization [req-bcdbebd2-da03-46f4-bd87-05ea7b674299 req-2a03e94b-2e8d-4b6b-b37e-a41b05117529 tempest-ServersTestFqdnHostnames-402908171 tempest-ServersTestFqdnHostnames-402908171-project-member] Enqueued Resource ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc with Priority: HIGHEST for action security_group_members [ 820.585144] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc with Priority: HIGHEST for action security_group_members [ 820.585429] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.585550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.585612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.585822] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.585980] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.588774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.588858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.589784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.589952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.590175] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be0b8028-d9fc-4359-aba8-9adf2a89c6bc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.965105] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.965192] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.965241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.965451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.965535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.965717] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.965811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.965870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.966029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.966102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.966185] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 820.991901] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.991901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.991901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.991901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.991901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.999856] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 821.072137] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.072297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.072369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.072585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.072839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.072839] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 821.077112] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.077247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.077316] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.077507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.077677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.077677] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76ac522-d413-411a-995f-1682c0fc160f is going to be updated. [ 821.089634] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-505 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.089779] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.090056] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.090307] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.090690] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.090690] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.090826] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.091082] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.091680] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.091680] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.091680] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.091680] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.092240] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.092240] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.092240] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.092240] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.095800] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.095949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.096205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.096205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.096334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.096696] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.097386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.097386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.097386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.097386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.097386] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc is going to be updated. [ 821.102977] env[68109]: INFO networking_nsxv3.common.synchronization [req-e58b4507-71fc-48d3-9187-9649a106ffb7 req-6914a8c7-2944-401f-9728-2ff53f7c1d6e tempest-ListServerFiltersTestJSON-53590806 tempest-ListServerFiltersTestJSON-53590806-project-member] Enqueued Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 821.104763] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.105013] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.105125] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.106425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.106425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.109631] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.109809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.109916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.110131] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.113018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.113018] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 821.113188] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.114302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.114386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.114577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.114919] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.114919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.115070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.115181] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.115260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.115356] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.129453] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 821.130153] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76ac522-d413-411a-995f-1682c0fc160f in Status: IN_PROGRESS for 2s [ 821.137241] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.137403] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 821.137537] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.137716] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.138038] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-dcee7ea5-3dae-4939-94b5-f7d0059423ac taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.138250] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-dcee7ea5-3dae-4939-94b5-f7d0059423ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.138997] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-dcee7ea5-3dae-4939-94b5-f7d0059423ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.138997] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-dcee7ea5-3dae-4939-94b5-f7d0059423ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.138997] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcee7ea5-3dae-4939-94b5-f7d0059423ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.145458] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.145561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.145628] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.145841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.146026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.154178] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc in Status: IN_PROGRESS for 2s [ 821.483986] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.484503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.484503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.484664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.484980] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.617615] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.641654] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.641883] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.642030] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.642702] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.642702] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.642702] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port dcee7ea5-3dae-4939-94b5-f7d0059423ac not found, creating... [ 821.642891] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.643025] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.643318] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.643588] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.643779] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.644082] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.644268] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.644390] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.644656] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.644746] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.644855] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: dcee7ea5-3dae-4939-94b5-f7d0059423ac is going to be created. [ 821.672026] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.672950] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.672950] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.672950] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.672950] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.673245] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-dcee7ea5-3dae-4939-94b5-f7d0059423ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.988059] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.120919] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.132025] env[68109]: INFO networking_nsxv3.common.synchronization [req-85e93e6c-0055-4d51-8059-8ada5a2fd4ec req-ed743aa7-4585-4621-a0ef-f592e810e900 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGHEST for action security_group_members [ 822.132229] env[68109]: INFO networking_nsxv3.common.synchronization [req-85e93e6c-0055-4d51-8059-8ada5a2fd4ec req-ed743aa7-4585-4621-a0ef-f592e810e900 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: bd83fb66-04c3-490c-8329-38f25156511c with Priority: HIGHEST for action security_group_members [ 822.132363] env[68109]: INFO networking_nsxv3.common.synchronization [req-85e93e6c-0055-4d51-8059-8ada5a2fd4ec req-ed743aa7-4585-4621-a0ef-f592e810e900 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 822.132902] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGHEST for action security_group_members [ 822.133039] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd83fb66-04c3-490c-8329-38f25156511c with Priority: HIGHEST for action security_group_members [ 822.133143] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 822.133417] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76ac522-d413-411a-995f-1682c0fc160f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.135783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.135783] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd83fb66-04c3-490c-8329-38f25156511c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.135783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.135783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.135783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.135783] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.135783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.135783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.135783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.135783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.135783] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd83fb66-04c3-490c-8329-38f25156511c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.136580] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.136580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.186175] env[68109]: INFO networking_nsxv3.common.synchronization [req-85e93e6c-0055-4d51-8059-8ada5a2fd4ec req-ed743aa7-4585-4621-a0ef-f592e810e900 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_rules [ 822.186288] env[68109]: INFO networking_nsxv3.common.synchronization [req-85e93e6c-0055-4d51-8059-8ada5a2fd4ec req-ed743aa7-4585-4621-a0ef-f592e810e900 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 822.186615] env[68109]: INFO networking_nsxv3.common.synchronization [req-85e93e6c-0055-4d51-8059-8ada5a2fd4ec req-ed743aa7-4585-4621-a0ef-f592e810e900 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: bd83fb66-04c3-490c-8329-38f25156511c with Priority: HIGHEST for action security_group_rules [ 822.186615] env[68109]: INFO networking_nsxv3.common.synchronization [req-85e93e6c-0055-4d51-8059-8ada5a2fd4ec req-ed743aa7-4585-4621-a0ef-f592e810e900 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: bd83fb66-04c3-490c-8329-38f25156511c with Priority: HIGHEST for action security_group_members [ 822.186759] env[68109]: INFO networking_nsxv3.common.synchronization [req-85e93e6c-0055-4d51-8059-8ada5a2fd4ec req-ed743aa7-4585-4621-a0ef-f592e810e900 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGHEST for action security_group_rules [ 822.186857] env[68109]: INFO networking_nsxv3.common.synchronization [req-85e93e6c-0055-4d51-8059-8ada5a2fd4ec req-ed743aa7-4585-4621-a0ef-f592e810e900 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGHEST for action security_group_members [ 822.187076] env[68109]: INFO networking_nsxv3.common.synchronization [req-85e93e6c-0055-4d51-8059-8ada5a2fd4ec req-ed743aa7-4585-4621-a0ef-f592e810e900 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: e64768a9-133d-49fd-afca-b064042bbc21 with Priority: HIGHEST for action port [ 822.187480] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_rules [ 822.187626] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd83fb66-04c3-490c-8329-38f25156511c with Priority: HIGHEST for action security_group_rules [ 822.187719] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGHEST for action security_group_members [ 822.189771] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64768a9-133d-49fd-afca-b064042bbc21 with Priority: HIGHEST for action port [ 822.189771] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGHEST for action security_group_rules [ 822.189771] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 822.189771] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd83fb66-04c3-490c-8329-38f25156511c with Priority: HIGHEST for action security_group_members [ 822.189771] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.189771] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.189771] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd83fb66-04c3-490c-8329-38f25156511c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.189771] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.189771] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.189771] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.190128] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd83fb66-04c3-490c-8329-38f25156511c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.190641] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76ac522-d413-411a-995f-1682c0fc160f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.190735] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.190917] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-e64768a9-133d-49fd-afca-b064042bbc21 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.191068] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.191104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.191576] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.191709] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64768a9-133d-49fd-afca-b064042bbc21',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.192469] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76ac522-d413-411a-995f-1682c0fc160f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.192621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.192740] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.192818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.193033] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd83fb66-04c3-490c-8329-38f25156511c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.193121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.387262] env[68109]: INFO networking_nsxv3.common.synchronization [req-42d38353-bd3a-4778-ae19-0fbfea7133b3 req-23d5a5e9-400f-4885-846e-b3f811f6a806 service nova] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_rules [ 822.387449] env[68109]: INFO networking_nsxv3.common.synchronization [req-42d38353-bd3a-4778-ae19-0fbfea7133b3 req-23d5a5e9-400f-4885-846e-b3f811f6a806 service nova] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 822.387597] env[68109]: INFO networking_nsxv3.common.synchronization [req-42d38353-bd3a-4778-ae19-0fbfea7133b3 req-23d5a5e9-400f-4885-846e-b3f811f6a806 service nova] Enqueued Resource ID: dcee7ea5-3dae-4939-94b5-f7d0059423ac with Priority: HIGHEST for action port [ 822.387847] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_rules [ 822.387969] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 822.388072] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcee7ea5-3dae-4939-94b5-f7d0059423ac with Priority: HIGHEST for action port [ 822.388682] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.388809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.388875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.389085] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.389186] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.390273] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.390445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.390793] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcee7ea5-3dae-4939-94b5-f7d0059423ac taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.390951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcee7ea5-3dae-4939-94b5-f7d0059423ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.391070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcee7ea5-3dae-4939-94b5-f7d0059423ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.391340] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcee7ea5-3dae-4939-94b5-f7d0059423ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.391486] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcee7ea5-3dae-4939-94b5-f7d0059423ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.489380] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.623413] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.626440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.626440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.626440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.626440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.626440] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 is going to be updated. [ 822.637409] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd83fb66-04c3-490c-8329-38f25156511c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.654894] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.654894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.654894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.654894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.655224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.667399] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: IN_PROGRESS for 2s [ 822.695557] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd83fb66-04c3-490c-8329-38f25156511c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.695698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.695888] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e64768a9-133d-49fd-afca-b064042bbc21 with status ACTIVE [ 822.696079] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.696200] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.696265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.696469] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.696571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.696756] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.696852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.696924] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.697110] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.697190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.697873] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.697873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.697873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.697873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.697873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.697873] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e64768a9-133d-49fd-afca-b064042bbc21 is going to be updated. [ 822.719847] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.720048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.720127] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.720365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.720514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.720708] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.856128] env[68109]: INFO networking_nsxv3.common.synchronization [req-23310771-103c-4a8c-9731-d5e6769ec0ac req-52f0de07-36ec-43fc-856a-04372955ae63 tempest-FloatingIPsAssociationNegativeTestJSON-1329941591 tempest-FloatingIPsAssociationNegativeTestJSON-1329941591-project-member] Enqueued Resource ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac with Priority: HIGHEST for action security_group_members [ 822.856128] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac with Priority: HIGHEST for action security_group_members [ 822.856128] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.856478] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.856665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.857698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.858458] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.858708] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.858860] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.859144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.859322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.859500] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.897019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.897019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.897019] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dcee7ea5-3dae-4939-94b5-f7d0059423ac with status ACTIVE [ 822.897019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.897019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.897019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.897019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.897019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.897019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.897019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.897019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.897019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.897019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.897019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.897638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.897638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.897638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.897638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.897638] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dcee7ea5-3dae-4939-94b5-f7d0059423ac is going to be updated. [ 822.917115] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.917115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.917115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.917115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.917115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.917115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcee7ea5-3dae-4939-94b5-f7d0059423ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.992502] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 822.992502] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 823.010466] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 823.010466] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 deletion is rescheduled due to dependency. [ 823.010466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.010466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.010466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.010466] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.010466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.010466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.010466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.010466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.010466] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.140012] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 823.140248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.140487] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd83fb66-04c3-490c-8329-38f25156511c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.141666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.141876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.142074] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.142194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.142253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.142411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.142613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.142613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.142706] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.143930] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76ac522-d413-411a-995f-1682c0fc160f in Status: SUCCESS [ 823.144118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.144435] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.144619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.144952] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.144952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.144952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.145323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.145323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.145323] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.145884] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.146053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.146237] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.146237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.146792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.146792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.146792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.146792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.146792] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.151646] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.151780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.152733] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.152733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.152733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.152733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.152733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.152733] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.163577] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc in Status: SUCCESS [ 823.163735] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc deletion is rescheduled due to dependency. [ 823.163787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.199953] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.200436] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-139" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.200436] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-139" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.200634] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-139" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.201027] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.201165] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.201165] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.201375] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.201725] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.201843] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 823.201957] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.202297] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.202297] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.202297] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 823.202528] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.202528] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.221990] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.222212] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 823.222365] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.222541] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-139" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.223038] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-3816c4f0-9ebe-42a6-9349-2dc450f5d873 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.223038] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-3816c4f0-9ebe-42a6-9349-2dc450f5d873" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.223231] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-3816c4f0-9ebe-42a6-9349-2dc450f5d873" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.223410] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-3816c4f0-9ebe-42a6-9349-2dc450f5d873" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.223547] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3816c4f0-9ebe-42a6-9349-2dc450f5d873',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.361890] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.362028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.362071] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.362287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.362494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.362575] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.362675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.362740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.362895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.362970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.363067] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac already deleted. [ 823.363150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.512747] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.645601] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.645902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.645902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.646302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.646302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.646302] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd83fb66-04c3-490c-8329-38f25156511c is going to be created. [ 823.648134] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.648134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.654149] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.656030] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.661757] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.671243] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.671488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.671488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.671762] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.671879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.688740] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd83fb66-04c3-490c-8329-38f25156511c in Status: UNINITIALIZED for 2s [ 823.726796] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.727060] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.727223] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.727507] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.727661] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.727815] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 3816c4f0-9ebe-42a6-9349-2dc450f5d873 not found, creating... [ 823.728089] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.728249] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.728375] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.728622] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.728763] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.729175] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.729947] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.729947] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.729947] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.729947] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.729947] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 3816c4f0-9ebe-42a6-9349-2dc450f5d873 is going to be created. [ 823.755514] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.755752] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.755891] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.756234] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.756537] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.756794] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-3816c4f0-9ebe-42a6-9349-2dc450f5d873" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.997862] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.998058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.998093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.998309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.009335] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 824.012017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.012814] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 824.013962] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.072265] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.072414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.072460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.072833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.078171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.078704] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:1. [ 824.078775] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'e64768a9-133d-49fd-afca-b064042bbc21'} {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 824.078882] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 824.115370] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.115553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.115637] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.115908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.117615] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.117747] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 824.159900] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f76ac522-d413-411a-995f-1682c0fc160f: rpc.has_security_group_logging(os_id): False [ 824.161467] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.166316] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.183904] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.184081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.184155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.184319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.184424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.184671] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.184835] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.184874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.185190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.185190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.185190] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76ac522-d413-411a-995f-1682c0fc160f is going to be created. [ 824.189610] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.189783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.189822] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.189970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.190186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.190394] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 824.251046] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.251171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.251171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.251439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.251700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.261236] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.261400] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.261485] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.261712] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.261935] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.262195] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:38. [ 824.262280] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'9e88ca4b-470a-485c-b906-6c8d635109cb', '3bd26aad-19e8-435d-b39a-5875f3b5cfd7', 'ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2', '820483a1-f34f-4ee1-b022-881132391bad', 'aa5eec70-e6f3-4480-95eb-d20df1020e05', '37f5dbb0-40eb-4b23-be82-699bd65bcb79', '0c7bce9f-4d75-4868-81b4-a0c0e5e4f420', '747242aa-4753-441a-b06c-3f9a70ac6a6e', '50bf3a02-de03-46e5-a1de-389d8f706b9b', '7188635c-e1c3-4fba-9e1d-f639d22a02e3', 'e830dadd-514a-4590-801f-e2bdf550c9d4', '841d58e8-0316-41e3-a855-66ac66e6d9f4', 'aaac1254-fb03-45ff-9ca3-f0edf21f5dad', '1589ee36-8ec7-4a35-a6c9-857230faca44', '58813947-23b6-4e9d-aed6-9b1d65b5728b', '884a937d-f25c-4b98-be12-acfbdb273d70', 'be0b8028-d9fc-4359-aba8-9adf2a89c6bc', '7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac', 'cbc22896-640c-4f05-bfd9-6290e8092bb2', '2f5de880-5f98-48cf-ba2c-fdf857770d6a', '14fbc65b-2397-4f06-bab2-162f42e5d290', 'f7eff74c-b690-47ef-ba84-9ec9d2765c99', 'e79c46e7-8141-49ae-9d8a-e8124ebeb86c', '817904c7-035a-41ce-bf21-c0db158c7bea', '835f674b-2b51-49ea-acd5-6a176ad00616', 'd063caf8-0f34-48a0-8035-c8a07c90a01c', '327a22ab-0003-41d7-851d-6eba37a2b9dc', '9353334a-e1b0-43d9-9c87-a08b8516326e', 'f76ac522-d413-411a-995f-1682c0fc160f', 'ee121dc7-4686-4564-b58a-255456cf3857', '80fea482-6d64-4937-892c-62371db01817', '3775fbff-3109-41e9-a7b4-71b12133d9f0', '04d6d7e9-ac4d-4788-ab37-9ef94a13367a', 'd2db7fe9-82f8-4d20-b269-363d052050b8', '2a8ad551-9243-4b5e-a0bd-acf823c5b01f', 'fe094fad-6ec3-4179-88a0-da40e49c0ff5', 'a1b52ab9-23fb-4785-af13-8d3e64d2b62f', '02bc3e4c-0cd7-46a0-8516-a78e344aa1a0'} {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 824.262389] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 824.264141] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76ac522-d413-411a-995f-1682c0fc160f in Status: IN_PROGRESS for 2s [ 824.284198] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.284378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.284443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.284622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.284709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.284826] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 824.284891] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 824.284954] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 824.392147] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.392325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.392397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.392604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.393585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.393894] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 824.393967] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 824.394058] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 824.394132] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Ports [ 824.394221] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e64768a9-133d-49fd-afca-b064042bbc21 with Priority: HIGH for action port [ 824.394305] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 19/38 resources of Type:Security Group Rules [ 824.394369] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e88ca4b-470a-485c-b906-6c8d635109cb with Priority: HIGH for action security_group_rules [ 824.394436] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGH for action security_group_rules [ 824.394499] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 with Priority: HIGH for action security_group_rules [ 824.394562] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 820483a1-f34f-4ee1-b022-881132391bad with Priority: HIGH for action security_group_rules [ 824.394624] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGH for action security_group_rules [ 824.394687] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 with Priority: HIGH for action security_group_rules [ 824.394781] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 with Priority: HIGH for action security_group_rules [ 824.394864] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGH for action security_group_rules [ 824.394928] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGH for action security_group_rules [ 824.394991] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGH for action security_group_rules [ 824.395065] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e830dadd-514a-4590-801f-e2bdf550c9d4 with Priority: HIGH for action security_group_rules [ 824.395126] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGH for action security_group_rules [ 824.395188] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad with Priority: HIGH for action security_group_rules [ 824.395250] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGH for action security_group_rules [ 824.395361] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b with Priority: HIGH for action security_group_rules [ 824.395361] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 884a937d-f25c-4b98-be12-acfbdb273d70 with Priority: HIGH for action security_group_rules [ 824.395444] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc with Priority: HIGH for action security_group_rules [ 824.395478] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac with Priority: HIGH for action security_group_rules [ 824.395535] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGH for action security_group_rules [ 824.395633] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.455887] env[68109]: INFO networking_nsxv3.common.synchronization [req-23310771-103c-4a8c-9731-d5e6769ec0ac req-7f071448-5db7-495c-ba9e-532697aba559 service nova] Enqueued Resource ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac with Priority: HIGHEST for action security_group_rules [ 824.456088] env[68109]: INFO networking_nsxv3.common.synchronization [req-23310771-103c-4a8c-9731-d5e6769ec0ac req-7f071448-5db7-495c-ba9e-532697aba559 service nova] Enqueued Resource ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac with Priority: HIGHEST for action security_group_members [ 824.456234] env[68109]: INFO networking_nsxv3.common.synchronization [req-23310771-103c-4a8c-9731-d5e6769ec0ac req-7f071448-5db7-495c-ba9e-532697aba559 service nova] Enqueued Resource ID: 3816c4f0-9ebe-42a6-9349-2dc450f5d873 with Priority: HIGHEST for action port [ 824.456470] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac with Priority: HIGHEST for action security_group_rules [ 824.456610] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac with Priority: HIGHEST for action security_group_members [ 824.456750] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3816c4f0-9ebe-42a6-9349-2dc450f5d873 with Priority: HIGHEST for action port [ 824.456813] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e64768a9-133d-49fd-afca-b064042bbc21 with Priority: HIGH for action port [ 824.456892] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGH for action security_group_rules [ 824.456985] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 with Priority: HIGH for action security_group_rules [ 824.457257] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGH for action security_group_rules [ 824.457364] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGH for action security_group_rules [ 824.457456] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac with Priority: HIGH for action security_group_rules [ 824.457933] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc with Priority: HIGH for action security_group_rules [ 824.458066] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 884a937d-f25c-4b98-be12-acfbdb273d70 with Priority: HIGH for action security_group_rules [ 824.458625] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad with Priority: HIGH for action security_group_rules [ 824.458865] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b with Priority: HIGH for action security_group_rules [ 824.458994] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGH for action security_group_rules [ 824.459107] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e830dadd-514a-4590-801f-e2bdf550c9d4 with Priority: HIGH for action security_group_rules [ 824.459204] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGH for action security_group_rules [ 824.459297] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGH for action security_group_rules [ 824.459385] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGH for action security_group_rules [ 824.459488] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 with Priority: HIGH for action security_group_rules [ 824.459555] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 with Priority: HIGH for action security_group_rules [ 824.459644] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820483a1-f34f-4ee1-b022-881132391bad with Priority: HIGH for action security_group_rules [ 824.459776] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e88ca4b-470a-485c-b906-6c8d635109cb with Priority: HIGH for action security_group_rules [ 824.459827] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 with Priority: HIGH for action security_group_rules [ 824.460396] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.460514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.460587] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.460839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.460917] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.461892] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.462031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.462099] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.462248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.462393] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.462483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.462542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.462684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.462766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.462844] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.463610] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-3816c4f0-9ebe-42a6-9349-2dc450f5d873 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.463780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3816c4f0-9ebe-42a6-9349-2dc450f5d873" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.464657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3816c4f0-9ebe-42a6-9349-2dc450f5d873" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.464657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3816c4f0-9ebe-42a6-9349-2dc450f5d873" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.464657] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3816c4f0-9ebe-42a6-9349-2dc450f5d873',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.465636] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-e64768a9-133d-49fd-afca-b064042bbc21 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.465636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.465636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.465636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.465874] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e64768a9-133d-49fd-afca-b064042bbc21',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.467503] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.469244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.469244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.469244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.469244] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.469495] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37f5dbb0-40eb-4b23-be82-699bd65bcb79 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.469495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.469495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.469606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.469699] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37f5dbb0-40eb-4b23-be82-699bd65bcb79',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.471441] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1589ee36-8ec7-4a35-a6c9-857230faca44 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.471441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.471441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.471441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.471441] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1589ee36-8ec7-4a35-a6c9-857230faca44',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.473028] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.473127] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.473127] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.473263] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.473342] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.473577] env[68109]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 824.474327] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.474430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.474496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.474644] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.474744] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.476589] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.476710] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.476784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.476955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.477058] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be0b8028-d9fc-4359-aba8-9adf2a89c6bc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.478124] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-884a937d-f25c-4b98-be12-acfbdb273d70 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.478430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.478502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.478653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.478726] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('884a937d-f25c-4b98-be12-acfbdb273d70',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.479976] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aaac1254-fb03-45ff-9ca3-f0edf21f5dad taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.480105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.480171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.480337] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.480426] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aaac1254-fb03-45ff-9ca3-f0edf21f5dad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.481472] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58813947-23b6-4e9d-aed6-9b1d65b5728b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.481588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.481647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.481806] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.481875] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58813947-23b6-4e9d-aed6-9b1d65b5728b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.482826] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.482927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.482968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.483111] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.483199] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.484054] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e830dadd-514a-4590-801f-e2bdf550c9d4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.484175] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.484230] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.484413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.484512] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e830dadd-514a-4590-801f-e2bdf550c9d4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.485431] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.485550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.485630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.485832] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.485911] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.486912] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50bf3a02-de03-46e5-a1de-389d8f706b9b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.487354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.487465] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.487996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.488137] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.488988] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-747242aa-4753-441a-b06c-3f9a70ac6a6e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.489121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.489186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.489396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.489481] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('747242aa-4753-441a-b06c-3f9a70ac6a6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.489713] env[68109]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 824.490410] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa5eec70-e6f3-4480-95eb-d20df1020e05 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.490512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.490572] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.490720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.490791] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa5eec70-e6f3-4480-95eb-d20df1020e05',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.491667] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.491763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.491822] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.491966] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.492050] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c7bce9f-4d75-4868-81b4-a0c0e5e4f420',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.492946] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-820483a1-f34f-4ee1-b022-881132391bad taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.493091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.493164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.493315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.493385] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('820483a1-f34f-4ee1-b022-881132391bad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.494226] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e88ca4b-470a-485c-b906-6c8d635109cb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.494457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.494457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.494550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.494615] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e88ca4b-470a-485c-b906-6c8d635109cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.495488] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.495594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.495661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.495821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.495891] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.500094] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.501699] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3816c4f0-9ebe-42a6-9349-2dc450f5d873 with status ACTIVE [ 824.501699] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.501837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.501837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.501991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.502091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.502294] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.502396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.502455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.502598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.502676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.502853] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.502965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.503035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.503172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.503245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.503329] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3816c4f0-9ebe-42a6-9349-2dc450f5d873 is going to be updated. [ 824.516443] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.516605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.516651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.516790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.516873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.516965] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 824.530252] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.530392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.530435] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.530616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.530747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.530909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3816c4f0-9ebe-42a6-9349-2dc450f5d873" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.547996] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.548156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.548244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.548418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.548556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.556784] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 824.663696] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.663991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.663991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.664567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.664567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.664567] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76ac522-d413-411a-995f-1682c0fc160f is going to be updated. [ 824.668976] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.669143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.670346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.670346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.670346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.670346] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 824.688824] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: SUCCESS [ 824.689139] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.729825] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.729825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.729825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.729825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.730117] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.732028] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.732028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.732028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.732363] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.732363] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.742346] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 824.742346] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76ac522-d413-411a-995f-1682c0fc160f in Status: IN_PROGRESS for 2s [ 824.998736] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.998736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.007454] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.039499] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.039618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.039687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.040019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.040146] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.040307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.040377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.040539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.040630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.040906] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.040906] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.046665] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.046665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.046665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.046853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.047346] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.047346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.047346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.047346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.047565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.047565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.047631] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.048529] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.048683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.048821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.048952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.049199] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.049277] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.049312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.049436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.049511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.049592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.049681] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.052844] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e88ca4b-470a-485c-b906-6c8d635109cb taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.052844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.052844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.052844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.052844] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.052844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.052844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.052844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.052844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.052844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.052844] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e88ca4b-470a-485c-b906-6c8d635109cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.053430] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-747242aa-4753-441a-b06c-3f9a70ac6a6e taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.053744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.053744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.053744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.053905] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.053992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.054062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.054202] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.054273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.054354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.054428] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('747242aa-4753-441a-b06c-3f9a70ac6a6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.056734] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e64768a9-133d-49fd-afca-b064042bbc21 with status ACTIVE [ 825.056916] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.057074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.057161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.057320] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.057359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.057510] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.057600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.057659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.057795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.057866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.058047] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.058134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.058192] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.058327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.058409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.058494] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e64768a9-133d-49fd-afca-b064042bbc21 is going to be updated. [ 825.059799] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1589ee36-8ec7-4a35-a6c9-857230faca44 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.059983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.059983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.060119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.060445] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.060445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.060445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.060599] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.060599] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.060666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.060745] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1589ee36-8ec7-4a35-a6c9-857230faca44',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.071385] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.071552] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.071597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.071893] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.077121] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e88ca4b-470a-485c-b906-6c8d635109cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.080460] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.116630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.116630] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b is going to be deleted. [ 825.121127] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.121270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.121545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.121671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.124657] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.124778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.130645] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.130759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.139638] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.139765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.144320] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.144428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.150471] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.150471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.150729] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.151392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.151738] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.151834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.162508] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.162586] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.163244] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.163341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.166085] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.167170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.172085] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 825.172569] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.172747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.174592] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 825.175233] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.175442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.176062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.176332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.176527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.176734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e64768a9-133d-49fd-afca-b064042bbc21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.177504] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 825.177924] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.178073] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 884a937d-f25c-4b98-be12-acfbdb273d70 is going to be deleted. [ 825.179198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.179436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.208386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.208386] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58813947-23b6-4e9d-aed6-9b1d65b5728b is going to be deleted. [ 825.208686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.208686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.253540] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.253540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.261697] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.261774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.275892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.275892] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 820483a1-f34f-4ee1-b022-881132391bad is going to be deleted. [ 825.276738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.277247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.310479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.310627] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac is going to be deleted. [ 825.311606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.311825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.349173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.349355] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2 is going to be deleted. [ 825.350417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.351347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.391406] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.391565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.427693] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.427806] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.445857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.446029] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c7bce9f-4d75-4868-81b4-a0c0e5e4f420 is going to be deleted. [ 825.446995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.447224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.467164] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.467164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.478606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.478740] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be0b8028-d9fc-4359-aba8-9adf2a89c6bc is going to be deleted. [ 825.479718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.479907] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.508291] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.508415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.509939] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.509939] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be deleted. [ 825.510424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.510622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.513190] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.513190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.513190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.513190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.513190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.513190] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac is going to be created. [ 825.559579] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.559734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.559807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.560029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.560192] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.562134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.562260] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e830dadd-514a-4590-801f-e2bdf550c9d4 is going to be deleted. [ 825.563486] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.563590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.563658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.563905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.564050] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.564201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c7bce9f-4d75-4868-81b4-a0c0e5e4f420" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.564810] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.565112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.566601] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1589ee36-8ec7-4a35-a6c9-857230faca44',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.568766] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.568916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.569019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.569248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.569474] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.569650] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.569792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.569876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.569971] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.570170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.570373] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.570503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.570592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.570783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.570973] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.571344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.571344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.571500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.571500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.571595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.571714] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.574271] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('747242aa-4753-441a-b06c-3f9a70ac6a6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.581609] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.581736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.581822] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.582058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.582249] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.582375] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.582457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.582636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.582823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.582953] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.583157] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.583425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.583425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.583595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.583719] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.583836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.583920] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.584106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.584205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.584311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.584420] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.586362] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 841d58e8-0316-41e3-a855-66ac66e6d9f4: rpc.has_security_group_logging(os_id): False [ 825.587610] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e88ca4b-470a-485c-b906-6c8d635109cb: rpc.has_security_group_logging(os_id): False [ 825.606214] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac in Status: UNINITIALIZED for 2s [ 825.637371] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.637497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.653276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.653407] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aaac1254-fb03-45ff-9ca3-f0edf21f5dad is going to be deleted. [ 825.654388] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.654598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.684801] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.685403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.721215] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.721493] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.730945] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd83fb66-04c3-490c-8329-38f25156511c in Status: SUCCESS [ 825.731067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.731267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.731625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.731922] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.732119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.732219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.732500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.732635] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.732798] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd83fb66-04c3-490c-8329-38f25156511c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.745163] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.745361] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.751939] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.752139] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa5eec70-e6f3-4480-95eb-d20df1020e05 is going to be deleted. [ 825.753251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.753505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.753563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.753781] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.754007] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.754207] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.754413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.754725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-884a937d-f25c-4b98-be12-acfbdb273d70" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.755364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.755597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.755743] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.755873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58813947-23b6-4e9d-aed6-9b1d65b5728b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.756062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.756177] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.756354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.756628] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-820483a1-f34f-4ee1-b022-881132391bad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.756881] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.757328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.757328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.757328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab2ab7c9-f0f9-4e92-8475-9fe6c6504cf2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.757467] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.757610] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.757687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.757798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ff4d9fc-29b5-4c13-ae75-0123ccd2b7ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.757939] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.758095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.790514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.790676] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37f5dbb0-40eb-4b23-be82-699bd65bcb79 is going to be deleted. [ 825.791727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.792259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.853391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.853965] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.853965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.853965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.854170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.854256] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.854354] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e88ca4b-470a-485c-b906-6c8d635109cb is going to be updated. [ 825.855558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.855741] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.917333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.917666] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.917767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.917823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.918054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.918123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.918258] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be updated. [ 825.919379] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.919554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.919729] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.919795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be0b8028-d9fc-4359-aba8-9adf2a89c6bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.919885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.922186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.922335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.922514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.923388] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.923529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.923598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.924299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.924299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.924299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aaac1254-fb03-45ff-9ca3-f0edf21f5dad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.924720] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.924944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.924944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.925098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.925177] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.925292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e830dadd-514a-4590-801f-e2bdf550c9d4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.955402] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.955565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.955646] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.955840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.955946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.956077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37f5dbb0-40eb-4b23-be82-699bd65bcb79" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.956943] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.957105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.957168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.957392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.957498] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.957769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa5eec70-e6f3-4480-95eb-d20df1020e05" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.968209] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.968209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.968209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.968613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.968613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.987738] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e88ca4b-470a-485c-b906-6c8d635109cb in Status: IN_PROGRESS for 2s [ 826.016760] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 826.020204] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.020204] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.020204] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.020204] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.020204] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.050100] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: IN_PROGRESS for 2s [ 826.073021] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1589ee36-8ec7-4a35-a6c9-857230faca44: rpc.has_security_group_logging(os_id): False [ 826.078281] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7188635c-e1c3-4fba-9e1d-f639d22a02e3: rpc.has_security_group_logging(os_id): False [ 826.079073] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 747242aa-4753-441a-b06c-3f9a70ac6a6e: rpc.has_security_group_logging(os_id): False [ 826.095530] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbc22896-640c-4f05-bfd9-6290e8092bb2: rpc.has_security_group_logging(os_id): False [ 826.113358] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.113624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.113624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.114053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.116146] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.116359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.117527] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.117724] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.119346] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.119502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.159054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.159054] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.159291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.159291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.159923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.159923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.159923] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.159923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.160079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.160183] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.160244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.160447] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.160528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.160583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.160799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.160838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.161145] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 is going to be updated. [ 826.162557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.162811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.195350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.195670] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.195670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.195670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.196116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.196234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.196339] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e is going to be updated. [ 826.197957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.197957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.217732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.218053] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.218187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.218262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.218473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.218562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.218761] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.218859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.218929] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.219092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.219165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.219349] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.219454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.219510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.219656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.219732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.219815] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 is going to be updated. [ 826.220919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.221104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.236589] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd83fb66-04c3-490c-8329-38f25156511c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.255780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.256237] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.256421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.256421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.256621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.256705] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.256799] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 is going to be updated. [ 826.272562] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.272764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.272764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.272992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.273350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.287992] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.288213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.288311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.288554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.288711] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.307290] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76ac522-d413-411a-995f-1682c0fc160f in Status: SUCCESS [ 826.307488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.307676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.307901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.308010] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.309518] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e in Status: IN_PROGRESS for 2s [ 826.315906] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: IN_PROGRESS for 2s [ 826.404020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.405987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.406493] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.406600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.406857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.409771] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.410062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.410217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.410547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.410802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.429137] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: IN_PROGRESS for 2s [ 826.432917] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: IN_PROGRESS for 2s [ 826.567306] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 826.567856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.567856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.568104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.568256] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.568380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.568443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.568617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.568707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.568859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.568922] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.572971] env[68109]: INFO networking_nsxv3.common.synchronization [req-1795ddfb-628c-4d9b-ace6-f9f43a85e2c8 req-eaacec5d-32ac-4c31-961d-a6cc2593392e tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: bd83fb66-04c3-490c-8329-38f25156511c with Priority: HIGHEST for action security_group_members [ 826.575021] env[68109]: INFO networking_nsxv3.common.synchronization [req-1795ddfb-628c-4d9b-ace6-f9f43a85e2c8 req-eaacec5d-32ac-4c31-961d-a6cc2593392e tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 826.575021] env[68109]: INFO networking_nsxv3.common.synchronization [req-1795ddfb-628c-4d9b-ace6-f9f43a85e2c8 req-eaacec5d-32ac-4c31-961d-a6cc2593392e tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGHEST for action security_group_members [ 826.575021] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd83fb66-04c3-490c-8329-38f25156511c with Priority: HIGHEST for action security_group_members [ 826.575021] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 826.575021] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGHEST for action security_group_members [ 826.575021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd83fb66-04c3-490c-8329-38f25156511c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.575021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.575021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.575021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.575894] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76ac522-d413-411a-995f-1682c0fc160f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.575894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.745381] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd83fb66-04c3-490c-8329-38f25156511c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.753144] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 826.753144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.753144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.753144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.753144] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.753512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.753512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.753512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.753512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.754165] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.755617] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76ac522-d413-411a-995f-1682c0fc160f in Status: SUCCESS [ 826.755696] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.755907] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.756117] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.756448] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.756798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.756798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.756798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.756798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.756993] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.815778] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76ac522-d413-411a-995f-1682c0fc160f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.815971] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.072022] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.072022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.072022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.072022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.072022] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.072022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.072415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.072415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.072415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.072415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.072600] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.072677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.072756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.072906] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.074123] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.074123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.074123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.074123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.074123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.074123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.074123] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.248132] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.250517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.252312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.252552] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.252694] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.252988] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd83fb66-04c3-490c-8329-38f25156511c is going to be updated. [ 827.259576] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.260418] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.260580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.260680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.260948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.261126] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.261296] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.261381] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.261430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.261614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.261870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.261870] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76ac522-d413-411a-995f-1682c0fc160f is going to be updated. [ 827.297049] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.297049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.297049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.297049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.297049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.307415] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd83fb66-04c3-490c-8329-38f25156511c in Status: IN_PROGRESS for 2s [ 827.309090] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.309247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.309301] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.309543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.309718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.321097] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76ac522-d413-411a-995f-1682c0fc160f in Status: IN_PROGRESS for 2s [ 827.576374] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3775fbff-3109-41e9-a7b4-71b12133d9f0: rpc.has_security_group_logging(os_id): False [ 827.590728] env[68109]: INFO networking_nsxv3.common.synchronization [req-99f2998c-43b0-47e9-84fc-dc4bd9cf60f2 req-50ebade6-8c03-4baa-b7fd-fa0b584d9347 tempest-ImagesTestJSON-447768907 tempest-ImagesTestJSON-447768907-project-member] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 827.591273] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 827.591580] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.591723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.591835] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.592090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.592197] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.592291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.592291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.592440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.592522] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.592654] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.594203] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.594319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.594375] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.594535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.614075] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac in Status: UNINITIALIZED for 4s [ 827.618936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.618936] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.618936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.618936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.619185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.619185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.619382] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.619484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.619542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.619693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.619768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.619948] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.620174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.620174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.620282] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.620345] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.620508] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 827.691989] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.692245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.692361] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.692678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.692932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.845212] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.857379] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 827.963022] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.963022] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.963022] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.963022] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.963022] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.963022] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.963022] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.963366] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.963482] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.967038] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.967038] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.967038] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.967038] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.967038] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.967038] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.967038] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.982720] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.983045] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 827.983045] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.983235] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.984938] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-d436e26c-747c-4a7c-a6e9-594adfc21d33 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.984938] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-d436e26c-747c-4a7c-a6e9-594adfc21d33" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.984938] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-d436e26c-747c-4a7c-a6e9-594adfc21d33" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.984938] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-d436e26c-747c-4a7c-a6e9-594adfc21d33" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.984938] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d436e26c-747c-4a7c-a6e9-594adfc21d33',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.000061] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e88ca4b-470a-485c-b906-6c8d635109cb in Status: SUCCESS [ 828.000290] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.061941] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 828.062215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.098761] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.098945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.098995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.099207] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.099292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.102531] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.102531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.102531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.102531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.102531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.102531] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be deleted. [ 828.137129] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.137322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.137402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.137756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.137756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.137930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.326023] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e in Status: SUCCESS [ 828.326023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.328699] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: SUCCESS [ 828.328914] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.347016] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.347159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.347245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.347432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.347520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.347617] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 828.372917] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.373105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.373173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.373510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.373775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.381966] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 828.456384] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: IN_PROGRESS for 4s [ 828.459974] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: SUCCESS [ 828.460203] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.486657] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.486888] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.487033] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.487329] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.487793] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.488143] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port d436e26c-747c-4a7c-a6e9-594adfc21d33 not found, creating... [ 828.488430] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.488595] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.488719] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.488960] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.489120] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.489406] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.489560] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.489683] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.489904] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.490054] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.490205] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: d436e26c-747c-4a7c-a6e9-594adfc21d33 is going to be created. [ 828.510035] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.510234] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.510363] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.510835] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.511099] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.511359] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-d436e26c-747c-4a7c-a6e9-594adfc21d33" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.264568] env[68109]: INFO networking_nsxv3.common.synchronization [req-99f2998c-43b0-47e9-84fc-dc4bd9cf60f2 req-eeabc71e-d488-415c-804d-1e8218540fc7 service nova] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_rules [ 829.264981] env[68109]: INFO networking_nsxv3.common.synchronization [req-99f2998c-43b0-47e9-84fc-dc4bd9cf60f2 req-eeabc71e-d488-415c-804d-1e8218540fc7 service nova] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 829.264981] env[68109]: INFO networking_nsxv3.common.synchronization [req-99f2998c-43b0-47e9-84fc-dc4bd9cf60f2 req-eeabc71e-d488-415c-804d-1e8218540fc7 service nova] Enqueued Resource ID: d436e26c-747c-4a7c-a6e9-594adfc21d33 with Priority: HIGHEST for action port [ 829.265565] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_rules [ 829.265721] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 829.265830] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d436e26c-747c-4a7c-a6e9-594adfc21d33 with Priority: HIGHEST for action port [ 829.266156] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.266289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.266350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.266552] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.266637] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.267512] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.267631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.267682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.267841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.267993] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.268095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.268188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.268360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.268425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.268550] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.270877] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-d436e26c-747c-4a7c-a6e9-594adfc21d33 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.270877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d436e26c-747c-4a7c-a6e9-594adfc21d33" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.270877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d436e26c-747c-4a7c-a6e9-594adfc21d33" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.270877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d436e26c-747c-4a7c-a6e9-594adfc21d33" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.270877] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d436e26c-747c-4a7c-a6e9-594adfc21d33',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.316570] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd83fb66-04c3-490c-8329-38f25156511c in Status: SUCCESS [ 829.316783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.317288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.317524] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.317714] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.317827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.317888] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.318062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.318144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.318229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.318325] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd83fb66-04c3-490c-8329-38f25156511c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.319121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.319280] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.319439] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.319548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.319604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.319730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.319807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.319892] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd83fb66-04c3-490c-8329-38f25156511c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.329273] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76ac522-d413-411a-995f-1682c0fc160f in Status: SUCCESS [ 829.329991] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76ac522-d413-411a-995f-1682c0fc160f deletion is rescheduled due to dependency. [ 829.330137] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.330285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.330483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.330993] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.330993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.330993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.330993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.331153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.331153] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.627495] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac in Status: SUCCESS [ 829.628239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.628239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.628239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.628524] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.628709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.629339] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.629339] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.629339] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.630069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.630069] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.772799] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.772799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.773235] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.775032] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d436e26c-747c-4a7c-a6e9-594adfc21d33 with status ACTIVE [ 829.775235] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.775418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.775534] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.775694] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.775784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.776008] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.776129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.776287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.776459] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.776536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.776842] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.776842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.777027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.777082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.777134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.777238] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d436e26c-747c-4a7c-a6e9-594adfc21d33 is going to be updated. [ 829.799722] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.800118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.800237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.800698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.800698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.800842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d436e26c-747c-4a7c-a6e9-594adfc21d33" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.821225] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd83fb66-04c3-490c-8329-38f25156511c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.822396] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.822618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.822618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.823312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.823312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.823312] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.823312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.823588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.823588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.823694] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.823694] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd83fb66-04c3-490c-8329-38f25156511c is going to be deleted. [ 829.836324] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.836749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.836857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.837093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.837189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.837416] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.837512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.837579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.837739] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.837815] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.838382] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76ac522-d413-411a-995f-1682c0fc160f is going to be updated. [ 829.854791] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.854953] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.854998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.855240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.855335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.855436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.867265] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.867464] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.867551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.867843] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.868180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.870711] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 829.870909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.876266] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76ac522-d413-411a-995f-1682c0fc160f in Status: IN_PROGRESS for 2s [ 830.138657] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.138657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.138657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.138657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.138657] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.138657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.138657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.138657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.138657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.138657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.138657] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.138657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.138657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.138657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.138657] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.138657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.139321] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.139321] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.139321] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.139321] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.139321] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.277148] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.326033] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd83fb66-04c3-490c-8329-38f25156511c: rpc.has_security_group_logging(os_id): False [ 830.328114] env[68109]: INFO networking_nsxv3.common.synchronization [req-852c775f-1f34-4a3f-8301-b1e954239777 req-7a803bf2-e38b-4910-b1de-6e2c3535f0a8 tempest-ServerTagsTestJSON-1634603372 tempest-ServerTagsTestJSON-1634603372-project-member] Enqueued Resource ID: 115f89cb-8059-4b36-912a-10de0703affe with Priority: HIGHEST for action security_group_members [ 830.331772] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 115f89cb-8059-4b36-912a-10de0703affe with Priority: HIGHEST for action security_group_members [ 830.332446] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-115f89cb-8059-4b36-912a-10de0703affe taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.332578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.332648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.332905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.333077] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.333181] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.333243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.333396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.333481] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.333577] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('115f89cb-8059-4b36-912a-10de0703affe',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.348850] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.349010] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.349071] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.349287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.349375] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.349597] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.349704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.349766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.349912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.350029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.350168] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd83fb66-04c3-490c-8329-38f25156511c is going to be created. [ 830.366982] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/bd83fb66-04c3-490c-8329-38f25156511c], does not exist path=[/infra/domains/default/groups/bd83fb66-04c3-490c-8329-38f25156511c]."\n}' [ 830.366982] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd83fb66-04c3-490c-8329-38f25156511c failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/bd83fb66-04c3-490c-8329-38f25156511c [ 830.367138] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 830.391170] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 830.392763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.392929] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.394563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.394563] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.394563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.394563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.394563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.394563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.394563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.394563] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.394563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.394563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.394563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.394563] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.394563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.395291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.395789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.395908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.396101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.397204] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.398547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.398848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.398934] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.399091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.399161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.399335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.399430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.399540] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.405276] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.405472] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.405548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.405793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.407734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.407734] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.407734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.408055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.408055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.408115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.408341] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.408474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.408662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.409747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.409747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.409747] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd83fb66-04c3-490c-8329-38f25156511c is going to be created. [ 830.426778] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/bd83fb66-04c3-490c-8329-38f25156511c], does not exist path=[/infra/domains/default/groups/bd83fb66-04c3-490c-8329-38f25156511c]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/bd83fb66-04c3-490c-8329-38f25156511c [ 830.426978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd83fb66-04c3-490c-8329-38f25156511c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.427533] env[68109]: Traceback (most recent call last): [ 830.427533] env[68109]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 830.427533] env[68109]: return func(*args, **kwargs) [ 830.427779] env[68109]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 830.427779] env[68109]: res.raise_for_status() [ 830.427779] env[68109]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 830.427779] env[68109]: raise HTTPError(http_error_msg, response=self) [ 830.427779] env[68109]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/bd83fb66-04c3-490c-8329-38f25156511c [ 830.427779] env[68109]: During handling of the above exception, another exception occurred: [ 830.427779] env[68109]: Traceback (most recent call last): [ 830.427779] env[68109]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 830.427779] env[68109]: listener.cb(fileno) [ 830.427779] env[68109]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 830.427779] env[68109]: result = function(*args, **kwargs) [ 830.427779] env[68109]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 830.427779] env[68109]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 830.427779] env[68109]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 830.427779] env[68109]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 830.427779] env[68109]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 830.427779] env[68109]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 830.427779] env[68109]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 830.427779] env[68109]: res.raise_for_status() [ 830.427779] env[68109]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 830.427779] env[68109]: raise HTTPError(http_error_msg, response=self) [ 830.427779] env[68109]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/bd83fb66-04c3-490c-8329-38f25156511c [ 830.427779] env[68109]: Removing descriptor: 71 [ 830.509889] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: IN_PROGRESS for 6s [ 830.641858] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac: rpc.has_security_group_logging(os_id): False [ 830.666692] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.666841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.666913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.667168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.667261] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.667516] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.667809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.667809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.667977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.668084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.668298] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.668399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.668460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.668601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.670245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.670245] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.670245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.670245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.670245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.670245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.670245] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac is going to be created. [ 830.743809] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.744009] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.744091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.744368] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.744479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.756554] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac in Status: IN_PROGRESS for 2s [ 830.779252] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.779410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.779483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.779699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.779795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.779902] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be created. [ 830.809202] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.809202] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.809202] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.809202] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.809389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.822055] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: UNINITIALIZED for 2s [ 830.837928] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.838130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.838175] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.838393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.838482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.838694] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.838793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.838856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.839015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.839095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.839183] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 115f89cb-8059-4b36-912a-10de0703affe already deleted. [ 830.839263] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.908019] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.911458] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a8ad551-9243-4b5e-a0bd-acf823c5b01f: rpc.has_security_group_logging(os_id): False [ 830.935457] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.935592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.935760] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.935879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.956912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.958028] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.958028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.958028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.958028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.958028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.958028] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.958028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.958410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.958410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.958410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.958502] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.958554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.958704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.958778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.958828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.958913] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 831.020015] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.020015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.020015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.020015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.020015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.038244] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 831.121804] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-187 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.123039] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-187" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.123039] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-187" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.123039] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-187" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.123525] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.123905] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.124198] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.127016] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.127016] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.127016] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.127016] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.127016] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.127016] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.127016] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.127016] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.127016] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.158976] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.158976] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 831.158976] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.158976] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-187" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.158976] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-6e666117-272f-41c4-bc59-8131b6dd8d1b taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.158976] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-6e666117-272f-41c4-bc59-8131b6dd8d1b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.158976] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-6e666117-272f-41c4-bc59-8131b6dd8d1b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.163020] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-6e666117-272f-41c4-bc59-8131b6dd8d1b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.163020] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e666117-272f-41c4-bc59-8131b6dd8d1b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.410201] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.588214] env[68109]: INFO networking_nsxv3.common.synchronization [req-0dc199ef-e2bc-40ed-9cd4-611b297e0b56 req-8a617805-a365-4a05-b414-f31ac41e0c22 tempest-ServerActionsV293TestJSON-1191773725 tempest-ServerActionsV293TestJSON-1191773725-project-member] Enqueued Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGHEST for action security_group_members [ 831.588817] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGHEST for action security_group_members [ 831.589131] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1589ee36-8ec7-4a35-a6c9-857230faca44 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.591474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.591567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.591788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.591963] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.593915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.594134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.594963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.596563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.596692] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1589ee36-8ec7-4a35-a6c9-857230faca44',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.667257] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.667257] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.667257] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.667460] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.667460] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.667620] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 6e666117-272f-41c4-bc59-8131b6dd8d1b not found, creating... [ 831.667906] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.668123] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.668831] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.668831] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.668980] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.669272] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.669451] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.669569] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.669967] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.670021] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.670165] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 6e666117-272f-41c4-bc59-8131b6dd8d1b is going to be created. [ 831.701663] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.701663] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.701663] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.701663] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.701663] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.701663] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-6e666117-272f-41c4-bc59-8131b6dd8d1b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.888640] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76ac522-d413-411a-995f-1682c0fc160f in Status: SUCCESS [ 831.888640] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76ac522-d413-411a-995f-1682c0fc160f deletion is rescheduled due to dependency. [ 831.888640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.888640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.888640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.888640] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.888640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.888640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.888640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.888640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.888640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.888640] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.915713] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.915713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.915713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.915713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.915713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.915713] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 831.941871] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.941871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.941871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.941871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.941871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.949971] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 832.100977] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.101197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.101285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.101535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.122814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.123163] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.123320] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.123374] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.123977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.123977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.123977] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 is going to be updated. [ 832.156656] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.159626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.159626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.159626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.159626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.169026] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: IN_PROGRESS for 2s [ 832.391777] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.466917] env[68109]: INFO networking_nsxv3.common.synchronization [None req-62958aa0-e000-4777-b101-090e1af67a52 None None] Enqueued Resource ID: 795596eb-1627-4256-9989-2ff936128737 with Priority: HIGHEST for action port [ 832.469202] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 795596eb-1627-4256-9989-2ff936128737 with Priority: HIGHEST for action port [ 832.469585] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-795596eb-1627-4256-9989-2ff936128737 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.471622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-795596eb-1627-4256-9989-2ff936128737" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.471622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-795596eb-1627-4256-9989-2ff936128737" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.471622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-795596eb-1627-4256-9989-2ff936128737" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.471622] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('795596eb-1627-4256-9989-2ff936128737',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.525309] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: IN_PROGRESS for 8s [ 832.769762] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac in Status: SUCCESS [ 832.770031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.776414] env[68109]: INFO networking_nsxv3.common.synchronization [req-852c775f-1f34-4a3f-8301-b1e954239777 req-da90b043-13d9-45f0-900b-ab1b404ea842 service nova] Enqueued Resource ID: 115f89cb-8059-4b36-912a-10de0703affe with Priority: HIGHEST for action security_group_rules [ 832.776593] env[68109]: INFO networking_nsxv3.common.synchronization [req-852c775f-1f34-4a3f-8301-b1e954239777 req-da90b043-13d9-45f0-900b-ab1b404ea842 service nova] Enqueued Resource ID: 115f89cb-8059-4b36-912a-10de0703affe with Priority: HIGHEST for action security_group_members [ 832.776738] env[68109]: INFO networking_nsxv3.common.synchronization [req-852c775f-1f34-4a3f-8301-b1e954239777 req-da90b043-13d9-45f0-900b-ab1b404ea842 service nova] Enqueued Resource ID: 6e666117-272f-41c4-bc59-8131b6dd8d1b with Priority: HIGHEST for action port [ 832.776971] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 115f89cb-8059-4b36-912a-10de0703affe with Priority: HIGHEST for action security_group_rules [ 832.777102] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 115f89cb-8059-4b36-912a-10de0703affe with Priority: HIGHEST for action security_group_members [ 832.777193] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e666117-272f-41c4-bc59-8131b6dd8d1b with Priority: HIGHEST for action port [ 832.777747] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-115f89cb-8059-4b36-912a-10de0703affe taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.777881] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.778471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.778471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.778471] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('115f89cb-8059-4b36-912a-10de0703affe',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.780793] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-115f89cb-8059-4b36-912a-10de0703affe taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.780793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.780793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.780793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.780793] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.780793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.780793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.780793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.780793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.780793] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('115f89cb-8059-4b36-912a-10de0703affe',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.781263] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e666117-272f-41c4-bc59-8131b6dd8d1b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.781372] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e666117-272f-41c4-bc59-8131b6dd8d1b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.781439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e666117-272f-41c4-bc59-8131b6dd8d1b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.781594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e666117-272f-41c4-bc59-8131b6dd8d1b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.781693] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e666117-272f-41c4-bc59-8131b6dd8d1b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.830019] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 832.830019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.830019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.830019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.830019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.830019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.830379] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.833431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.833431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.833431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.833431] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.896939] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f76ac522-d413-411a-995f-1682c0fc160f: rpc.has_security_group_logging(os_id): False [ 832.918885] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.918885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.918885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.919593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.940591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.940774] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.940877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.940877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.941081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.941162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.941251] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76ac522-d413-411a-995f-1682c0fc160f is going to be updated. [ 832.972663] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 795596eb-1627-4256-9989-2ff936128737 [ 832.972982] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.973099] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.973191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.973409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.973505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.973606] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:795596eb-1627-4256-9989-2ff936128737 already deleted. [ 832.973689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-795596eb-1627-4256-9989-2ff936128737" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.992405] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.992586] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.992683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.993203] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.993502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.008451] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76ac522-d413-411a-995f-1682c0fc160f in Status: IN_PROGRESS for 2s [ 833.064672] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 833.064672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.064672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.064672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.064672] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.287388] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('115f89cb-8059-4b36-912a-10de0703affe',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.287388] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-115f89cb-8059-4b36-912a-10de0703affe taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.287388] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.287388] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e666117-272f-41c4-bc59-8131b6dd8d1b with status ACTIVE [ 833.287388] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.287388] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.287388] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.287388] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.287388] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.287388] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.287388] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.288424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.288424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.288424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.288424] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.288424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.292128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.292405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.292499] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.292604] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e666117-272f-41c4-bc59-8131b6dd8d1b is going to be updated. [ 833.322789] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.323119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.323199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.323434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.323596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.323781] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e666117-272f-41c4-bc59-8131b6dd8d1b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.334382] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.334511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.334590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.334882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.335119] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.335227] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.335393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.335521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.335647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.335815] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.336017] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.336184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.336250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.336391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.336542] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.336634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.336709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.336853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.336948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.337146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.337255] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.573064] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.573064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.796311] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('115f89cb-8059-4b36-912a-10de0703affe',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.841257] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bd26aad-19e8-435d-b39a-5875f3b5cfd7: rpc.has_security_group_logging(os_id): False [ 833.858411] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.858411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.858411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.858659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.858659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.858834] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.858891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.859065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.859239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.859455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.859578] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.859694] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.859694] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.859909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.860020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.860251] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.860365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.860426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.860592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.860674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.860753] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be created. [ 833.918307] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.918477] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.918477] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.918685] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.918871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.931298] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 833.961199] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 833.961423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.961592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.962270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.962270] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.962270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.962270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.962537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.962537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.962537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.962626] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.181402] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: SUCCESS [ 834.181597] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 deletion is rescheduled due to dependency. [ 834.182264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.298708] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.298801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.298846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.299170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.299170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.299311] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 115f89cb-8059-4b36-912a-10de0703affe is going to be created. [ 834.320820] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.321038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.321038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.321279] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.321445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.335149] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 115f89cb-8059-4b36-912a-10de0703affe in Status: UNINITIALIZED for 2s [ 834.468020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.468020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.468020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.468020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.468020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.468020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.468020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.468020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.468020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.468020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.468020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.468020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.468020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.468020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.468020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.468020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.469365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.469365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.471622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.471622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.471622] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.540102] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: IN_PROGRESS for 10s [ 834.975144] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a8ad551-9243-4b5e-a0bd-acf823c5b01f: rpc.has_security_group_logging(os_id): False [ 834.993021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.993021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.993021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.993021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.993021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.993021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.993021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.993021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.993021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.993021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.993021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.993021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.993021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.993021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.994090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.994597] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.995109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.995109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.995372] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.995590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.996696] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 835.020174] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76ac522-d413-411a-995f-1682c0fc160f in Status: SUCCESS [ 835.020421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.050925] env[68109]: INFO networking_nsxv3.common.synchronization [None req-711e29f5-5409-4b87-8530-2b1f92eafa1a None None] Enqueued Resource ID: 7119bdac-0966-4982-af78-e33c8251c99e with Priority: HIGHEST for action port [ 835.050925] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7119bdac-0966-4982-af78-e33c8251c99e with Priority: HIGHEST for action port [ 835.050925] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-7119bdac-0966-4982-af78-e33c8251c99e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.050925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7119bdac-0966-4982-af78-e33c8251c99e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.050925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7119bdac-0966-4982-af78-e33c8251c99e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.051958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7119bdac-0966-4982-af78-e33c8251c99e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.052063] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7119bdac-0966-4982-af78-e33c8251c99e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.057157] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.057157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.057157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.057375] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.057744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.092656] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 835.523019] env[68109]: INFO networking_nsxv3.common.synchronization [req-fb2634ba-a5f1-4225-b758-d072caace8f5 req-f1d38598-b1e2-4012-95d9-9a63df6a2951 tempest-ServersWithSpecificFlavorTestJSON-306442882 tempest-ServersWithSpecificFlavorTestJSON-306442882-project-member] Enqueued Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_members [ 835.523019] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_members [ 835.523447] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.523696] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.523862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.524167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.524522] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.524745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.524926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.525266] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.525441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.525617] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.554564] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7119bdac-0966-4982-af78-e33c8251c99e [ 835.556051] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.556051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.556051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.556051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.557106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.557106] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7119bdac-0966-4982-af78-e33c8251c99e already deleted. [ 835.557235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7119bdac-0966-4982-af78-e33c8251c99e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.946764] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 835.947010] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.028507] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.028507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.028507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.028900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.048642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.048982] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.049130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.049281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.049397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.049482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.049604] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f is going to be updated. [ 836.072977] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.073193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.073274] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.073446] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.073580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.081597] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f in Status: IN_PROGRESS for 2s [ 836.344646] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 115f89cb-8059-4b36-912a-10de0703affe in Status: SUCCESS [ 836.344646] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.344908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.345060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.345256] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.345372] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.345437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.345591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.345670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.345753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.345847] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('115f89cb-8059-4b36-912a-10de0703affe',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.551319] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: IN_PROGRESS for 12s [ 836.847913] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-115f89cb-8059-4b36-912a-10de0703affe taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.848087] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.848253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.848505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.848738] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.849099] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.849099] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.849243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.849243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.849438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.849599] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-115f89cb-8059-4b36-912a-10de0703affe taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.849839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.849839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.850531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.850531] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.850531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.850531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.850681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.850721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.850831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.850901] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('115f89cb-8059-4b36-912a-10de0703affe',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.116323] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 837.116323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.354939] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 115f89cb-8059-4b36-912a-10de0703affe: rpc.has_security_group_logging(os_id): False [ 837.374219] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.374402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.374402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.374607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.374698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.374891] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.374983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.375115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.375282] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.375361] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.375660] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.375755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.375847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.375984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.376128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.376315] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.376441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.376530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.376670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.376745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.376866] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 115f89cb-8059-4b36-912a-10de0703affe is going to be created. [ 837.456897] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.457111] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.457212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.457468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.457729] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.470216] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 115f89cb-8059-4b36-912a-10de0703affe in Status: IN_PROGRESS for 2s [ 838.092722] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f in Status: SUCCESS [ 838.092722] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f deletion is rescheduled due to dependency. [ 838.092722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.564493] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: IN_PROGRESS for 14s [ 839.482670] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 115f89cb-8059-4b36-912a-10de0703affe in Status: SUCCESS [ 839.482670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.354717] env[68109]: INFO networking_nsxv3.common.synchronization [req-98727b66-e4dc-4da0-ab93-fe28a56ae3db req-fdb9b2a0-f4f3-4a34-831c-d501d9423a1b tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 840.355525] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 840.355647] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.355773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.355836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.356147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.356384] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.356501] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.356562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.356732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.356821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.356917] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.589424] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: IN_PROGRESS for 16s [ 840.682204] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.682414] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.682540] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.682827] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.683137] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.683270] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.683390] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.683614] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.683817] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.684009] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 840.684164] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 840.684277] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 840.684387] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 840.684501] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 840.684608] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 840.684744] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 840.701751] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.701938] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 840.702100] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.702289] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.702617] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.702795] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.702944] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.703381] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.703529] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.862017] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.862184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.862246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.862469] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.862563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.862768] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.862867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.862930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.863106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.863182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.863270] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf already deleted. [ 840.863347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.209558] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.209746] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.209868] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.210192] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.210523] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.210523] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e not found, creating... [ 841.210769] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.210927] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.211060] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.211283] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.211543] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.211862] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.212057] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.212297] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.212474] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.212740] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.212740] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e is going to be created. [ 841.231913] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.232207] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.232340] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.232621] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.232856] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.233105] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.662129] env[68109]: INFO networking_nsxv3.common.synchronization [req-dd4621fe-674e-46c5-aeaf-23d94bf22c79 req-3309375f-c2d9-4d7a-acc6-62688eb71d4e tempest-MigrationsAdminTest-481783089 tempest-MigrationsAdminTest-481783089-project-member] Enqueued Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_members [ 841.662633] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_members [ 841.663620] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.663620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.663620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.663620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.663997] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.664208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.664332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.664538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.664657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.664782] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.167623] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.268925] env[68109]: INFO networking_nsxv3.common.synchronization [req-98727b66-e4dc-4da0-ab93-fe28a56ae3db req-305c9664-e4eb-445e-bf41-53f391eb7a43 service nova] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_rules [ 842.269192] env[68109]: INFO networking_nsxv3.common.synchronization [req-98727b66-e4dc-4da0-ab93-fe28a56ae3db req-305c9664-e4eb-445e-bf41-53f391eb7a43 service nova] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 842.269392] env[68109]: INFO networking_nsxv3.common.synchronization [req-98727b66-e4dc-4da0-ab93-fe28a56ae3db req-305c9664-e4eb-445e-bf41-53f391eb7a43 service nova] Enqueued Resource ID: 0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e with Priority: HIGHEST for action port [ 842.271588] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_rules [ 842.271770] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 842.271967] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e with Priority: HIGHEST for action port [ 842.272574] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.272811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.272955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.273456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.273636] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.275235] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.275440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.275578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.275849] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.276117] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.276311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.276456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.276761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.277081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.277360] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.280788] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.281046] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.281220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.281538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.282024] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.326580] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.326700] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.326837] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.327672] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.327672] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.327672] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.327907] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.328055] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.328218] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.329195] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 842.329195] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.329195] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.329195] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.329195] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 842.329195] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.329441] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.352601] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.352851] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 842.353020] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.355024] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.355024] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-57d7422e-94cb-4fbe-8e5b-dec82b409170 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.355024] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-57d7422e-94cb-4fbe-8e5b-dec82b409170" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.355024] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-57d7422e-94cb-4fbe-8e5b-dec82b409170" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.355024] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-57d7422e-94cb-4fbe-8e5b-dec82b409170" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.355024] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57d7422e-94cb-4fbe-8e5b-dec82b409170',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.601561] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 in Status: SUCCESS [ 842.601859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.671451] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.786787] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.786787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.787118] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.788125] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e with status ACTIVE [ 842.788400] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.788576] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.788722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.789166] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.789166] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.789317] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.789418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.789571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.790080] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.790080] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.790080] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.790213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.790295] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.790426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.790520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.790641] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e is going to be updated. [ 842.813406] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.813575] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.813616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.814028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.814208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.814407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f6791ca-5e7a-4a9c-bb52-9ce0d07b5c2e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.856605] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.857211] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.857455] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.857758] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.857918] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.858097] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 57d7422e-94cb-4fbe-8e5b-dec82b409170 not found, creating... [ 842.858373] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.858540] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.858661] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.858881] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.859031] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.859318] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.859474] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.859750] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.859847] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.859917] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.860066] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 57d7422e-94cb-4fbe-8e5b-dec82b409170 is going to be created. [ 842.878082] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.878292] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.878425] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.878638] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.878866] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.879120] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-57d7422e-94cb-4fbe-8e5b-dec82b409170" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.174319] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.174483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.174567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.174762] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.174851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.174953] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a is going to be updated. [ 843.204429] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.204623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.204668] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.204873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.205144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.214281] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a in Status: IN_PROGRESS for 2s [ 843.292941] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.792024] env[68109]: INFO networking_nsxv3.common.synchronization [req-dd4621fe-674e-46c5-aeaf-23d94bf22c79 req-a97f8c5e-ca0d-4d0b-99a0-9464f6be9d18 service nova] Enqueued Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_rules [ 843.792357] env[68109]: INFO networking_nsxv3.common.synchronization [req-dd4621fe-674e-46c5-aeaf-23d94bf22c79 req-a97f8c5e-ca0d-4d0b-99a0-9464f6be9d18 service nova] Enqueued Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_members [ 843.792417] env[68109]: INFO networking_nsxv3.common.synchronization [req-dd4621fe-674e-46c5-aeaf-23d94bf22c79 req-a97f8c5e-ca0d-4d0b-99a0-9464f6be9d18 service nova] Enqueued Resource ID: 57d7422e-94cb-4fbe-8e5b-dec82b409170 with Priority: HIGHEST for action port [ 843.792921] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_rules [ 843.793070] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_members [ 843.793174] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57d7422e-94cb-4fbe-8e5b-dec82b409170 with Priority: HIGHEST for action port [ 843.794840] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.794960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.795027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.795236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.795323] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.796293] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.799903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.799903] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-57d7422e-94cb-4fbe-8e5b-dec82b409170 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.799903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57d7422e-94cb-4fbe-8e5b-dec82b409170" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.799903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57d7422e-94cb-4fbe-8e5b-dec82b409170" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.799903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57d7422e-94cb-4fbe-8e5b-dec82b409170" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.799903] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57d7422e-94cb-4fbe-8e5b-dec82b409170',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.799903] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.799903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.799903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.799903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.799903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.799903] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be created. [ 843.821011] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.821373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.821373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.821513] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.821670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.829905] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: UNINITIALIZED for 2s [ 844.298601] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.299924] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.306130] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57d7422e-94cb-4fbe-8e5b-dec82b409170 with status ACTIVE [ 844.306130] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.306130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.306130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.306130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.306130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.306130] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.306130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.306130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.306130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.306130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.306130] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.306130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.306130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.306130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.306130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.306130] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57d7422e-94cb-4fbe-8e5b-dec82b409170 is going to be updated. [ 844.326658] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.326800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.327285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.327285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.327285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.327451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57d7422e-94cb-4fbe-8e5b-dec82b409170" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.403678] env[68109]: INFO networking_nsxv3.common.synchronization [req-123ba171-5b6d-421e-9497-5483b0d8759a req-51871b85-2661-4d3f-a42b-d7c9000a61ca tempest-ServersV294TestFqdnHostnames-578105793 tempest-ServersV294TestFqdnHostnames-578105793-project-member] Enqueued Resource ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 with Priority: HIGHEST for action security_group_members [ 844.404239] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 with Priority: HIGHEST for action security_group_members [ 844.404548] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f244466-a6a8-4118-96a9-bf22e5d33c96 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.404670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.404740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.405054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.405244] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.405329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.405329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.405545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.405545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.405654] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f244466-a6a8-4118-96a9-bf22e5d33c96',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.768697] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-304 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.768909] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-304" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.769052] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-304" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.769408] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-304" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.769676] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.769898] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.770032] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.770255] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.770405] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.770623] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.770736] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.770848] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.770960] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.771087] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.771199] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.771335] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.790201] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.790410] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 844.790562] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.790745] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-304" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.791073] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-1a1e488b-ad4d-4e23-b588-c71eeca05329 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.791258] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-1a1e488b-ad4d-4e23-b588-c71eeca05329" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.791385] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-1a1e488b-ad4d-4e23-b588-c71eeca05329" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.791720] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-1a1e488b-ad4d-4e23-b588-c71eeca05329" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.791894] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a1e488b-ad4d-4e23-b588-c71eeca05329',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.911283] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.911616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.911616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.912652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.912652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.912652] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.912652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.912652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.912652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.912652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.912652] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 already deleted. [ 844.912652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.015498] env[68109]: INFO networking_nsxv3.common.synchronization [req-aa5730c5-7703-4a8a-9dce-7484ceb9cb76 req-3119cb87-2344-4a7b-b06e-6b13d1485fcb tempest-VolumesAssistedSnapshotsTest-142452177 tempest-VolumesAssistedSnapshotsTest-142452177-project-member] Enqueued Resource ID: 80fea482-6d64-4937-892c-62371db01817 with Priority: HIGHEST for action security_group_members [ 845.016082] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80fea482-6d64-4937-892c-62371db01817 with Priority: HIGHEST for action security_group_members [ 845.016427] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-80fea482-6d64-4937-892c-62371db01817 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.016572] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.016617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.016805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.016954] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.017101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.017171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.017316] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.017397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.017481] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80fea482-6d64-4937-892c-62371db01817',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.225053] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a in Status: SUCCESS [ 845.225315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.225521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.225780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.225989] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.226126] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.226222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.226423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.226534] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.226653] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.294322] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.294596] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.294743] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.295142] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.295337] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.295519] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 1a1e488b-ad4d-4e23-b588-c71eeca05329 not found, creating... [ 845.295806] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.296029] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.296281] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.296438] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.296613] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.297389] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.297601] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.297740] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.297990] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.298169] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.298335] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 1a1e488b-ad4d-4e23-b588-c71eeca05329 is going to be created. [ 845.317478] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.317704] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.317760] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.318163] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.318422] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.318679] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-1a1e488b-ad4d-4e23-b588-c71eeca05329" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.520344] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.520651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.520790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.521134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.544051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.544343] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.544467] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.544529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.544741] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.544830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.544960] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80fea482-6d64-4937-892c-62371db01817 is going to be updated. [ 845.582172] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.582172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.582172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.582172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.582378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.592363] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80fea482-6d64-4937-892c-62371db01817 in Status: IN_PROGRESS for 2s [ 845.728949] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.839255] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 845.839616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.839791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.840073] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.840295] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.840420] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.840486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.840649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.840789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.841213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.841213] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.008621] env[68109]: INFO networking_nsxv3.common.synchronization [req-123ba171-5b6d-421e-9497-5483b0d8759a req-46a2d002-2827-4c8b-ac11-d33944114a8d service nova] Enqueued Resource ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 with Priority: HIGHEST for action security_group_rules [ 846.008869] env[68109]: INFO networking_nsxv3.common.synchronization [req-123ba171-5b6d-421e-9497-5483b0d8759a req-46a2d002-2827-4c8b-ac11-d33944114a8d service nova] Enqueued Resource ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 with Priority: HIGHEST for action security_group_members [ 846.008995] env[68109]: INFO networking_nsxv3.common.synchronization [req-123ba171-5b6d-421e-9497-5483b0d8759a req-46a2d002-2827-4c8b-ac11-d33944114a8d service nova] Enqueued Resource ID: 1a1e488b-ad4d-4e23-b588-c71eeca05329 with Priority: HIGHEST for action port [ 846.009258] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 with Priority: HIGHEST for action security_group_rules [ 846.009384] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 with Priority: HIGHEST for action security_group_members [ 846.009479] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1e488b-ad4d-4e23-b588-c71eeca05329 with Priority: HIGHEST for action port [ 846.010015] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f244466-a6a8-4118-96a9-bf22e5d33c96 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.010235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.010303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.010500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.010580] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f244466-a6a8-4118-96a9-bf22e5d33c96',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.011493] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f244466-a6a8-4118-96a9-bf22e5d33c96 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.011638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.011788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.012035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.012241] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.012371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.012455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.012642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.012755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.012874] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f244466-a6a8-4118-96a9-bf22e5d33c96',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.013906] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a1e488b-ad4d-4e23-b588-c71eeca05329 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.014039] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a1e488b-ad4d-4e23-b588-c71eeca05329" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.014167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a1e488b-ad4d-4e23-b588-c71eeca05329" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.014309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a1e488b-ad4d-4e23-b588-c71eeca05329" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.014405] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a1e488b-ad4d-4e23-b588-c71eeca05329',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.231688] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.344972] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.345162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.345277] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.345508] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.345688] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.345795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.345855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.346028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.346108] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.346202] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.346555] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.346555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.346642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.346715] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.346855] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.346947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.347012] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.347224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.347309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.347395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.347490] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.516351] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f244466-a6a8-4118-96a9-bf22e5d33c96 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.516351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.516529] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f244466-a6a8-4118-96a9-bf22e5d33c96',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.517557] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a1e488b-ad4d-4e23-b588-c71eeca05329 with status ACTIVE [ 846.517760] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.517914] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.518040] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.518341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.518486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.518768] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.518922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.519040] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.519294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.519427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.519710] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.519857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.519980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.520222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.520354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.520494] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a1e488b-ad4d-4e23-b588-c71eeca05329 is going to be updated. [ 846.540967] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.541183] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.541232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.541559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.541749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.541924] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a1e488b-ad4d-4e23-b588-c71eeca05329" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.734935] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.735142] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.735216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.735433] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.735525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.735625] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a is going to be updated. [ 846.765014] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.765014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.765212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.765861] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.765861] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.775030] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a in Status: IN_PROGRESS for 2s [ 846.850121] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7573caa0-9f71-40fd-82c3-03fa2ce88dbf: rpc.has_security_group_logging(os_id): False [ 846.867792] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.868126] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.868245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.868465] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.868557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.868756] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.868861] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.868917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.869086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.869165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.869365] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.869463] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.869523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.869664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.869734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.869920] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.870030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.870089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.870227] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.870307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.870403] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be created. [ 846.927995] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.929221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.929221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.929221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.929221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.939627] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 847.023270] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f244466-a6a8-4118-96a9-bf22e5d33c96',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.527381] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.527562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.527892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.527892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.528058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.528097] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 is going to be created. [ 847.554421] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.554616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.554678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.554828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.554992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.566077] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 in Status: UNINITIALIZED for 2s [ 847.600957] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80fea482-6d64-4937-892c-62371db01817 in Status: SUCCESS [ 847.601211] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80fea482-6d64-4937-892c-62371db01817 deletion is rescheduled due to dependency. [ 847.601323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.785319] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a in Status: SUCCESS [ 848.785616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.785818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.786121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.786437] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.786596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.786690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.786940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.787077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.787222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.787381] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.952223] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 848.952443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.293019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.293019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.293019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.293019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.293019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.293019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.293019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.293019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.293019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.293019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.293019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.293019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.293019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.293019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.293019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.293019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.293832] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.293832] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.293832] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.293832] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.293832] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.579383] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 in Status: SUCCESS [ 849.579383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.579383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.579383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.579383] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.579383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.579383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.579383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.579383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.581697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.581697] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f244466-a6a8-4118-96a9-bf22e5d33c96',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.770138] env[68109]: INFO networking_nsxv3.common.synchronization [req-0b0ab767-af48-4c9f-b35f-5a80e6fc1b71 req-76dd81d5-2846-4b5d-abef-11532618d941 tempest-FloatingIPsAssociationNegativeTestJSON-1329941591 tempest-FloatingIPsAssociationNegativeTestJSON-1329941591-project-member] Enqueued Resource ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac with Priority: HIGHEST for action security_group_members [ 849.770346] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac with Priority: HIGHEST for action security_group_members [ 849.770654] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.771498] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.771699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.772082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.772295] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.772516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.772597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.772773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.772860] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.772998] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.798122] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f5de880-5f98-48cf-ba2c-fdf857770d6a: rpc.has_security_group_logging(os_id): False [ 849.815682] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.815837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.815947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.816144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.833406] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.833626] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.833756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.833827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.834136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.834225] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.834452] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.834550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.834614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.834763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.834837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.835063] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.835161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.835222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.835365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.835440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.835525] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a is going to be updated. [ 849.894442] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.894642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.894642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.894867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.895019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.912148] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a in Status: IN_PROGRESS for 2s [ 850.084286] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f244466-a6a8-4118-96a9-bf22e5d33c96',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.278330] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.278490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.278562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.278783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.278877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.279098] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.279254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.279254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.282825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.282825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.282825] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac is going to be updated. [ 850.309252] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.309252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.309252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.309252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.309252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.315129] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac in Status: IN_PROGRESS for 2s [ 850.592921] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f244466-a6a8-4118-96a9-bf22e5d33c96: rpc.has_security_group_logging(os_id): False [ 850.624035] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.624341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.624341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.624531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.624613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.624835] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.625107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.625264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.625354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.625430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.625502] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 is going to be created. [ 850.708803] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.708972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.709036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.709254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.709431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.731409] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 in Status: IN_PROGRESS for 2s [ 851.923623] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a in Status: SUCCESS [ 851.923942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.327629] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac in Status: SUCCESS [ 852.327629] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac deletion is rescheduled due to dependency. [ 852.327629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.743209] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 in Status: SUCCESS [ 852.743449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.034253] env[68109]: INFO networking_nsxv3.common.synchronization [req-9e1460e5-8c02-4c3e-b35a-c8bb48e56414 req-f5b4379c-bed4-436f-912f-209706c0abf0 tempest-ServerTagsTestJSON-1634603372 tempest-ServerTagsTestJSON-1634603372-project-member] Enqueued Resource ID: 115f89cb-8059-4b36-912a-10de0703affe with Priority: HIGHEST for action security_group_members [ 854.034827] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 115f89cb-8059-4b36-912a-10de0703affe with Priority: HIGHEST for action security_group_members [ 854.035259] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-115f89cb-8059-4b36-912a-10de0703affe taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.035379] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.035477] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.035667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.035853] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.035947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.036197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.036360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.036452] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.036550] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('115f89cb-8059-4b36-912a-10de0703affe',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.539307] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.539512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.539604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.539853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.539967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.540224] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.540360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.540485] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.540621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.540724] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.540836] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 115f89cb-8059-4b36-912a-10de0703affe is going to be updated. [ 854.567958] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.568199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.568259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.568512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.568663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.577938] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 115f89cb-8059-4b36-912a-10de0703affe in Status: IN_PROGRESS for 2s [ 855.806740] env[68109]: INFO networking_nsxv3.common.synchronization [None req-22618dbf-b97c-415f-8e40-dd142fe4767a None None] Enqueued Resource ID: a7ae44b0-f079-4cfc-bf27-836f7f4d0d93 with Priority: HIGHEST for action port [ 855.806740] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ae44b0-f079-4cfc-bf27-836f7f4d0d93 with Priority: HIGHEST for action port [ 855.809121] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7ae44b0-f079-4cfc-bf27-836f7f4d0d93 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.809121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7ae44b0-f079-4cfc-bf27-836f7f4d0d93" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.809121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7ae44b0-f079-4cfc-bf27-836f7f4d0d93" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.809121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7ae44b0-f079-4cfc-bf27-836f7f4d0d93" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.809121] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7ae44b0-f079-4cfc-bf27-836f7f4d0d93',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.245189] env[68109]: INFO networking_nsxv3.common.synchronization [None req-45889b0b-45dd-4e5d-80a3-dd6d14afd430 None None] Enqueued Resource ID: e7f09921-1de5-44fc-8500-b84b325dd2bd with Priority: HIGHEST for action port [ 856.245189] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7f09921-1de5-44fc-8500-b84b325dd2bd with Priority: HIGHEST for action port [ 856.245189] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7f09921-1de5-44fc-8500-b84b325dd2bd taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.245189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7f09921-1de5-44fc-8500-b84b325dd2bd" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.245189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7f09921-1de5-44fc-8500-b84b325dd2bd" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.245189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7f09921-1de5-44fc-8500-b84b325dd2bd" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.245189] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7f09921-1de5-44fc-8500-b84b325dd2bd',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.313022] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7ae44b0-f079-4cfc-bf27-836f7f4d0d93 [ 856.313022] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.313022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.313022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.313022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.313022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.313022] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7ae44b0-f079-4cfc-bf27-836f7f4d0d93 already deleted. [ 856.313022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7ae44b0-f079-4cfc-bf27-836f7f4d0d93" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.588932] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 115f89cb-8059-4b36-912a-10de0703affe in Status: SUCCESS [ 856.589231] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 115f89cb-8059-4b36-912a-10de0703affe deletion is rescheduled due to dependency. [ 856.589430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.747711] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7f09921-1de5-44fc-8500-b84b325dd2bd [ 856.747711] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.747860] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.747860] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.748104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.748184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.748293] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7f09921-1de5-44fc-8500-b84b325dd2bd already deleted. [ 856.748371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7f09921-1de5-44fc-8500-b84b325dd2bd" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.973174] env[68109]: INFO networking_nsxv3.common.synchronization [req-c84e19f5-5351-453d-a192-24ef87963f99 req-c52f3273-7be2-4839-9339-7bf86bd89038 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 856.973174] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 856.974291] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.974491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.974589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.974840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.975495] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.975495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.975495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.975495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.975495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.975787] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.479852] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.479852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.479852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.480119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.480270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.480598] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.480728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.480798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.480968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.481066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.481161] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 857.510233] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.510233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.510233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.510445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.510445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.520672] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 858.751332] env[68109]: INFO networking_nsxv3.common.synchronization [None req-b8fff321-013d-4226-8776-587f97a3d92b None None] Enqueued Resource ID: f7a309d7-d655-4d43-8b37-9f1e00b85fe2 with Priority: HIGHEST for action port [ 858.751644] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7a309d7-d655-4d43-8b37-9f1e00b85fe2 with Priority: HIGHEST for action port [ 858.752061] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7a309d7-d655-4d43-8b37-9f1e00b85fe2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.752187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7a309d7-d655-4d43-8b37-9f1e00b85fe2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.752250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7a309d7-d655-4d43-8b37-9f1e00b85fe2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.752494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7a309d7-d655-4d43-8b37-9f1e00b85fe2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.752574] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7a309d7-d655-4d43-8b37-9f1e00b85fe2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.830214] env[68109]: INFO networking_nsxv3.common.synchronization [None req-7a660b1c-6584-4fc2-8d68-d9e8249a5cfb None None] Enqueued Resource ID: 5755aca4-3126-41ab-9219-4ceb36df2579 with Priority: HIGHEST for action port [ 858.830739] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5755aca4-3126-41ab-9219-4ceb36df2579 with Priority: HIGHEST for action port [ 858.831045] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-5755aca4-3126-41ab-9219-4ceb36df2579 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.831169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5755aca4-3126-41ab-9219-4ceb36df2579" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.831233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5755aca4-3126-41ab-9219-4ceb36df2579" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.831479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5755aca4-3126-41ab-9219-4ceb36df2579" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.831558] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5755aca4-3126-41ab-9219-4ceb36df2579',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.254433] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7a309d7-d655-4d43-8b37-9f1e00b85fe2 [ 859.254943] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.255298] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.255698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.258218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.258218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.258218] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7a309d7-d655-4d43-8b37-9f1e00b85fe2 already deleted. [ 859.258218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7a309d7-d655-4d43-8b37-9f1e00b85fe2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.334655] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5755aca4-3126-41ab-9219-4ceb36df2579 [ 859.335042] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.335042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.335042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.336473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.336473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.336473] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5755aca4-3126-41ab-9219-4ceb36df2579 already deleted. [ 859.336473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5755aca4-3126-41ab-9219-4ceb36df2579" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.535894] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 859.535894] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf deletion is rescheduled due to dependency. [ 859.535894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.197349] env[68109]: INFO networking_nsxv3.common.synchronization [req-4692c9c0-8d5d-442f-9b6f-eb29f3fdf893 req-8b37d2cf-c13b-453f-88a5-8443a0da6ec9 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: d063caf8-0f34-48a0-8035-c8a07c90a01c with Priority: HIGHEST for action security_group_members [ 861.198401] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d063caf8-0f34-48a0-8035-c8a07c90a01c with Priority: HIGHEST for action security_group_members [ 861.198767] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-d063caf8-0f34-48a0-8035-c8a07c90a01c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.198919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.199394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.199394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.199394] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.199603] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.199603] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.199930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.199930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.199930] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d063caf8-0f34-48a0-8035-c8a07c90a01c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.705648] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.705648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.705648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.705648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.728026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.728026] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.728026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.728026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.728026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.728026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.728026] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d063caf8-0f34-48a0-8035-c8a07c90a01c is going to be updated. [ 861.753037] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.756512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.756693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.756851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.757014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.765040] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d063caf8-0f34-48a0-8035-c8a07c90a01c in Status: IN_PROGRESS for 2s [ 861.843543] env[68109]: INFO networking_nsxv3.common.synchronization [req-617d6c35-3a31-42b3-8fd9-cdd6eaa976f4 req-29a3880a-21d7-4dd0-b341-4c5694ad4ba0 tempest-ListServerFiltersTestJSON-53590806 tempest-ListServerFiltersTestJSON-53590806-project-member] Enqueued Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 861.844113] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 861.844417] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.844536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.844604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.846371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.846371] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.846371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.846371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.846562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.846624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.846724] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.349124] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.852570] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.356583] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.356896] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.356896] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.357055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.357158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.357261] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 is going to be updated. [ 863.384553] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.384731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.384795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.385016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.385155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.393229] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: IN_PROGRESS for 2s [ 863.776095] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d063caf8-0f34-48a0-8035-c8a07c90a01c in Status: SUCCESS [ 863.776285] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d063caf8-0f34-48a0-8035-c8a07c90a01c deletion is rescheduled due to dependency. [ 863.776409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.089856] env[68109]: INFO networking_nsxv3.common.synchronization [req-55c74ada-7411-4721-aaf0-8d76469993d6 req-29830515-1ee6-4d61-ad05-db78e332b0b4 tempest-ImagesTestJSON-447768907 tempest-ImagesTestJSON-447768907-project-member] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 865.090402] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 865.090708] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.091171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.091171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.091171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.091393] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.091471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.091527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.091657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.091750] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.091828] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.404836] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: SUCCESS [ 865.405141] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.597243] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.597445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.597516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.597739] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.597886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.598850] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.598850] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.598850] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.598850] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.598850] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.598850] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be updated. [ 865.630300] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.630555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.630645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.630839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.631104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.639621] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 867.649848] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 867.650136] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 deletion is rescheduled due to dependency. [ 867.650171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.800137] env[68109]: INFO networking_nsxv3.common.synchronization [req-c6669023-38c2-491c-b86a-3141893069b6 req-74388b2b-d67e-45b5-bd07-ad7f3cb59f22 tempest-ListImageFiltersTestJSON-1245384511 tempest-ListImageFiltersTestJSON-1245384511-project-member] Enqueued Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_members [ 867.800526] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_members [ 867.800841] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.800963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.801080] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.801358] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.801543] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.801637] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.801701] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.801859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.801940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.802057] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.305947] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.306296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.306296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.306570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.306699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.306936] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.307091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.307177] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.307371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.307478] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.307610] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e812d957-e1ec-4f99-86c2-485e7c16988a already deleted. [ 868.307692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.599725] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.599936] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.600077] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.600349] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.600626] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.600779] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.600899] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.601129] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.601302] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.601499] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.601649] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.601744] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.601829] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.602044] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.602134] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.602430] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.619946] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.620223] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 868.620360] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.620641] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.621213] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-8c45ac58-6532-45e6-b4d1-8a0618c36547 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.621213] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-8c45ac58-6532-45e6-b4d1-8a0618c36547" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.621358] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-8c45ac58-6532-45e6-b4d1-8a0618c36547" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.621545] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-8c45ac58-6532-45e6-b4d1-8a0618c36547" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.621688] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c45ac58-6532-45e6-b4d1-8a0618c36547',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.732852] env[68109]: INFO networking_nsxv3.common.synchronization [req-b3bf0910-7168-476b-87c5-4635001a8d96 req-dca867ff-99f2-4fc4-8db8-47abeaef68f8 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 9e88ca4b-470a-485c-b906-6c8d635109cb with Priority: HIGHEST for action security_group_members [ 868.733103] env[68109]: INFO networking_nsxv3.common.synchronization [req-b3bf0910-7168-476b-87c5-4635001a8d96 req-dca867ff-99f2-4fc4-8db8-47abeaef68f8 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGHEST for action security_group_members [ 868.733103] env[68109]: INFO networking_nsxv3.common.synchronization [req-b3bf0910-7168-476b-87c5-4635001a8d96 req-dca867ff-99f2-4fc4-8db8-47abeaef68f8 tempest-SecurityGroupsTestJSON-185986649 tempest-SecurityGroupsTestJSON-185986649-project-member] Enqueued Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 868.736654] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e88ca4b-470a-485c-b906-6c8d635109cb with Priority: HIGHEST for action security_group_members [ 868.736654] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGHEST for action security_group_members [ 868.736654] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f with Priority: HIGHEST for action security_group_members [ 868.736654] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e88ca4b-470a-485c-b906-6c8d635109cb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.736654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.736654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.736654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.736654] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.736654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.736654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.736654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.736654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.736654] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e88ca4b-470a-485c-b906-6c8d635109cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.737053] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.737053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.737118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.737246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.737370] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.737457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.737536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.737644] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.737714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.737793] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.738949] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.739103] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.739209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.739702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.739702] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.739702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.739702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.739702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.739897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.739897] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a8ad551-9243-4b5e-a0bd-acf823c5b01f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.124231] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.124541] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.124723] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.125113] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.125327] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.125500] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 8c45ac58-6532-45e6-b4d1-8a0618c36547 not found, creating... [ 869.125770] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.125930] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.126067] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.126296] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.126458] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.126757] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.126903] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.127035] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.127258] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.127391] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.127546] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 8c45ac58-6532-45e6-b4d1-8a0618c36547 is going to be created. [ 869.147047] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.147270] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.147414] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.147683] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.147916] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.148160] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-8c45ac58-6532-45e6-b4d1-8a0618c36547" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.241774] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.241980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.242060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.242270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.243589] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.243695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.243941] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.244073] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.271262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.271490] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.271597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.271666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.271854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.271999] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.272104] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e88ca4b-470a-485c-b906-6c8d635109cb is going to be updated. [ 869.272984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.273167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.312946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.313171] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.313317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.313389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.313659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.313754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.313849] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a is going to be updated. [ 869.314763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.314923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.315030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.315211] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.315314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.315377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.315517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.315593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.315676] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f is going to be updated. [ 869.317045] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.317158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.317227] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.317374] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.317496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.330523] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e88ca4b-470a-485c-b906-6c8d635109cb in Status: IN_PROGRESS for 2s [ 869.347485] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.347646] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.347742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.347977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.348166] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.349901] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.350056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.350238] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.350471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.350606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.358159] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a in Status: IN_PROGRESS for 2s [ 869.358784] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: IN_PROGRESS for 2s [ 870.006194] env[68109]: INFO networking_nsxv3.common.synchronization [req-c6669023-38c2-491c-b86a-3141893069b6 req-d350ef4f-0a44-4958-afa5-868b695d93d2 service nova] Enqueued Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_rules [ 870.006194] env[68109]: INFO networking_nsxv3.common.synchronization [req-c6669023-38c2-491c-b86a-3141893069b6 req-d350ef4f-0a44-4958-afa5-868b695d93d2 service nova] Enqueued Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_members [ 870.006194] env[68109]: INFO networking_nsxv3.common.synchronization [req-c6669023-38c2-491c-b86a-3141893069b6 req-d350ef4f-0a44-4958-afa5-868b695d93d2 service nova] Enqueued Resource ID: 8c45ac58-6532-45e6-b4d1-8a0618c36547 with Priority: HIGHEST for action port [ 870.008512] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_rules [ 870.008512] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_members [ 870.008512] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c45ac58-6532-45e6-b4d1-8a0618c36547 with Priority: HIGHEST for action port [ 870.008512] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.008512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.008512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.008872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.009049] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.010090] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.015048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.015143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.015324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.015525] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.015749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.015749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.015997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.016088] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.016218] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.017061] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c45ac58-6532-45e6-b4d1-8a0618c36547 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.017169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c45ac58-6532-45e6-b4d1-8a0618c36547" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.017234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c45ac58-6532-45e6-b4d1-8a0618c36547" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.017391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c45ac58-6532-45e6-b4d1-8a0618c36547" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.017467] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c45ac58-6532-45e6-b4d1-8a0618c36547',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.262903] env[68109]: INFO networking_nsxv3.common.synchronization [req-96e6d5ff-b453-4dcc-9c6d-0eaf2df3364f req-ae8b8760-b69a-4f4d-9f17-8e739e404a0a tempest-ListImageFiltersTestJSON-1245384511 tempest-ListImageFiltersTestJSON-1245384511-project-member] Enqueued Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_members [ 870.263434] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_members [ 870.263721] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.263818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.519184] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.520517] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.525367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.525367] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c45ac58-6532-45e6-b4d1-8a0618c36547 with status ACTIVE [ 870.525367] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.525367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.525367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.525367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.525367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.525367] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.525367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.525367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.525367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.525367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.525367] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.525367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.525367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.525367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.525367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.526030] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c45ac58-6532-45e6-b4d1-8a0618c36547 is going to be updated. [ 870.547174] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.547383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.547494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.547797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.547969] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.548242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c45ac58-6532-45e6-b4d1-8a0618c36547" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.558375] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-876 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.558700] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.558948] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.559410] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.559756] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.559996] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.560500] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.560885] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.561103] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.561467] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.561623] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.561766] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.561888] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.562091] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.562313] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.562538] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.586279] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.586611] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 870.586848] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.587119] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-876" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.587592] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-0f3cd3b5-af8e-4f00-a998-82d028e7e678 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.587803] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-0f3cd3b5-af8e-4f00-a998-82d028e7e678" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.587989] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-0f3cd3b5-af8e-4f00-a998-82d028e7e678" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.588458] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-0f3cd3b5-af8e-4f00-a998-82d028e7e678" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.588635] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f3cd3b5-af8e-4f00-a998-82d028e7e678',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.028643] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.094418] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.094671] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.094836] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.095108] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.095265] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.095646] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 0f3cd3b5-af8e-4f00-a998-82d028e7e678 not found, creating... [ 871.095699] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.095832] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.095949] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.096551] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.096551] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.096730] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.096886] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.097011] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.097253] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.097398] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.097542] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 0f3cd3b5-af8e-4f00-a998-82d028e7e678 is going to be created. [ 871.116561] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.116793] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.116921] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.117285] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.117532] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.117775] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-0f3cd3b5-af8e-4f00-a998-82d028e7e678" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.339804] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e88ca4b-470a-485c-b906-6c8d635109cb in Status: SUCCESS [ 871.339984] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e88ca4b-470a-485c-b906-6c8d635109cb deletion is rescheduled due to dependency. [ 871.340116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.368791] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a in Status: SUCCESS [ 871.368976] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a deletion is rescheduled due to dependency. [ 871.369187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.369911] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f in Status: SUCCESS [ 871.370139] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a8ad551-9243-4b5e-a0bd-acf823c5b01f deletion is rescheduled due to dependency. [ 871.370223] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a8ad551-9243-4b5e-a0bd-acf823c5b01f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.531287] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.531471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.531542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.531766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.531855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.531955] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e812d957-e1ec-4f99-86c2-485e7c16988a is going to be created. [ 871.552717] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.552879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.552879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.553217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.553401] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.561509] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e812d957-e1ec-4f99-86c2-485e7c16988a in Status: UNINITIALIZED for 2s [ 871.788827] env[68109]: INFO networking_nsxv3.common.synchronization [req-96e6d5ff-b453-4dcc-9c6d-0eaf2df3364f req-9a5ab49d-d435-41e6-b9d3-1be13bb56842 service nova] Enqueued Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_rules [ 871.788928] env[68109]: INFO networking_nsxv3.common.synchronization [req-96e6d5ff-b453-4dcc-9c6d-0eaf2df3364f req-9a5ab49d-d435-41e6-b9d3-1be13bb56842 service nova] Enqueued Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_members [ 871.789086] env[68109]: INFO networking_nsxv3.common.synchronization [req-96e6d5ff-b453-4dcc-9c6d-0eaf2df3364f req-9a5ab49d-d435-41e6-b9d3-1be13bb56842 service nova] Enqueued Resource ID: 0f3cd3b5-af8e-4f00-a998-82d028e7e678 with Priority: HIGHEST for action port [ 871.789385] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_rules [ 871.789523] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_members [ 871.789622] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3cd3b5-af8e-4f00-a998-82d028e7e678 with Priority: HIGHEST for action port [ 871.790172] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.790302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.790493] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.790542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.790715] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f3cd3b5-af8e-4f00-a998-82d028e7e678 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.790814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f3cd3b5-af8e-4f00-a998-82d028e7e678" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.790879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f3cd3b5-af8e-4f00-a998-82d028e7e678" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.791083] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f3cd3b5-af8e-4f00-a998-82d028e7e678" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.791163] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f3cd3b5-af8e-4f00-a998-82d028e7e678',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.293961] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f3cd3b5-af8e-4f00-a998-82d028e7e678 with status ACTIVE [ 872.294327] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.294327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.294423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.294624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.294731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.294951] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.295129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.295199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.295367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.295448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.295634] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.295762] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.295787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.295915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.295983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.296074] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f3cd3b5-af8e-4f00-a998-82d028e7e678 is going to be updated. [ 872.319602] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.319792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.319864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.320053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.320199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.320391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f3cd3b5-af8e-4f00-a998-82d028e7e678" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.573448] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e812d957-e1ec-4f99-86c2-485e7c16988a in Status: SUCCESS [ 873.573712] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.574334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.574334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.574492] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.574551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.574596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.574762] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.574942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.574942] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.077416] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.579399] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.964392] env[68109]: INFO networking_nsxv3.common.synchronization [req-89b34205-7bdb-43c7-97ae-0bdd04a04373 req-38759177-db8c-4901-8454-6e8b5e3b69e8 tempest-ServersWithSpecificFlavorTestJSON-306442882 tempest-ServersWithSpecificFlavorTestJSON-306442882-project-member] Enqueued Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_members [ 874.964909] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_members [ 874.965246] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.965371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.965434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.965626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.966066] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.966207] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.966294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.966948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.967090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.967232] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.081868] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.082232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.082232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.082430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.082480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.082552] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e812d957-e1ec-4f99-86c2-485e7c16988a is going to be updated. [ 875.132532] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.132837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.132837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.133976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.133976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.154833] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e812d957-e1ec-4f99-86c2-485e7c16988a in Status: IN_PROGRESS for 2s [ 875.244531] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.244531] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-61" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.244531] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-61" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.244531] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-61" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.244531] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.244934] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.245250] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.245604] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.245880] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.246312] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 875.246620] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.246946] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.248094] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.248094] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 875.248094] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.248094] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.269358] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.269537] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 875.269685] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.269928] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-61" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.270326] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-5de876f5-ec7b-42e7-9f9a-b04babd7f6e7 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.270547] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-5de876f5-ec7b-42e7-9f9a-b04babd7f6e7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.270681] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-5de876f5-ec7b-42e7-9f9a-b04babd7f6e7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.270984] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-5de876f5-ec7b-42e7-9f9a-b04babd7f6e7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.271144] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5de876f5-ec7b-42e7-9f9a-b04babd7f6e7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.469974] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.469974] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.469974] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.469974] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.470228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.470800] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.470987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.471118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.471337] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.474920] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.474920] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f is going to be updated. [ 875.497642] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.497841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.497931] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.498212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.498394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.512183] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f in Status: IN_PROGRESS for 2s [ 875.774607] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.774989] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.774989] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.775627] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.775627] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.775768] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 5de876f5-ec7b-42e7-9f9a-b04babd7f6e7 not found, creating... [ 875.775964] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.776251] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.776251] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.776579] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.776718] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.777051] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.777238] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.777360] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.777562] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.777702] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.777848] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 5de876f5-ec7b-42e7-9f9a-b04babd7f6e7 is going to be created. [ 875.808846] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.809099] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.809249] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.809630] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.809891] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.810167] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-5de876f5-ec7b-42e7-9f9a-b04babd7f6e7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.489637] env[68109]: INFO networking_nsxv3.common.synchronization [req-89b34205-7bdb-43c7-97ae-0bdd04a04373 req-a7b0347a-e489-49c5-8065-b8704b92694b service nova] Enqueued Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_rules [ 876.489830] env[68109]: INFO networking_nsxv3.common.synchronization [req-89b34205-7bdb-43c7-97ae-0bdd04a04373 req-a7b0347a-e489-49c5-8065-b8704b92694b service nova] Enqueued Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_members [ 876.489976] env[68109]: INFO networking_nsxv3.common.synchronization [req-89b34205-7bdb-43c7-97ae-0bdd04a04373 req-a7b0347a-e489-49c5-8065-b8704b92694b service nova] Enqueued Resource ID: 5de876f5-ec7b-42e7-9f9a-b04babd7f6e7 with Priority: HIGHEST for action port [ 876.490236] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_rules [ 876.490367] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_members [ 876.490462] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de876f5-ec7b-42e7-9f9a-b04babd7f6e7 with Priority: HIGHEST for action port [ 876.491016] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.491204] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.491276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.491477] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.491601] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.492432] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.492528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.492711] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-5de876f5-ec7b-42e7-9f9a-b04babd7f6e7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.492812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5de876f5-ec7b-42e7-9f9a-b04babd7f6e7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.492876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5de876f5-ec7b-42e7-9f9a-b04babd7f6e7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.494184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5de876f5-ec7b-42e7-9f9a-b04babd7f6e7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.494184] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5de876f5-ec7b-42e7-9f9a-b04babd7f6e7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.995172] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.995458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.995537] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5de876f5-ec7b-42e7-9f9a-b04babd7f6e7 with status ACTIVE [ 876.995708] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.995821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.995885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.996140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.996198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.996400] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.996506] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.996597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.996715] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.996794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.996977] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.997119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.997146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.997293] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.997401] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.997509] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5de876f5-ec7b-42e7-9f9a-b04babd7f6e7 is going to be updated. [ 877.017238] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.017394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.017478] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.017710] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.018116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.018116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5de876f5-ec7b-42e7-9f9a-b04babd7f6e7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.164794] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e812d957-e1ec-4f99-86c2-485e7c16988a in Status: SUCCESS [ 877.164794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.164794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.164950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.165314] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.165483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.165668] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.165961] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.166336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.166615] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.166704] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.168220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.168429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.168719] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.168866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.168965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.169132] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.169212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.169300] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.521322] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f in Status: SUCCESS [ 877.521508] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f deletion is rescheduled due to dependency. [ 877.522423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.522655] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.522875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.523070] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.523190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.523258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.523413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.523495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.523594] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.559787] env[68109]: INFO networking_nsxv3.common.synchronization [req-a0b8952e-5132-4e1d-a3e9-6e0eb868544b req-4cdca0e5-96e8-48bd-9ebd-0e035cbd6ba0 tempest-ServerMetadataTestJSON-1086564351 tempest-ServerMetadataTestJSON-1086564351-project-member] Enqueued Resource ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 with Priority: HIGHEST for action security_group_members [ 877.560311] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 with Priority: HIGHEST for action security_group_members [ 877.560620] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-367414dc-5bb3-4cf0-b02d-c624234144c1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.560741] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.560810] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.561527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.561592] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.561718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.561792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.561962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.562066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.562162] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('367414dc-5bb3-4cf0-b02d-c624234144c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.671493] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.671493] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.671493] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.848808] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-551 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.848969] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-551" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.849026] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-551" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.850913] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-551" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.850913] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.850913] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.850913] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.850913] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.850913] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.850913] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 877.851324] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 877.851324] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 877.851324] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 877.851324] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 877.851429] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 877.851542] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 877.868705] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 877.868877] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 877.869042] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 877.869245] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-551" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.869568] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-9891c5c2-2fa5-4773-abef-3bb7dd1d522d taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.869744] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-9891c5c2-2fa5-4773-abef-3bb7dd1d522d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.869864] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-9891c5c2-2fa5-4773-abef-3bb7dd1d522d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.870221] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-9891c5c2-2fa5-4773-abef-3bb7dd1d522d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.870402] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9891c5c2-2fa5-4773-abef-3bb7dd1d522d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.025575] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.068567] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.068567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.068567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.068567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.068567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.068748] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.068748] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.068748] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.068891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.068960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.069070] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 already deleted. [ 878.069162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.173360] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.374380] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.374658] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.375918] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.375918] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.375918] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.375918] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 9891c5c2-2fa5-4773-abef-3bb7dd1d522d not found, creating... [ 878.376143] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.376393] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.376586] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.376919] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.377161] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.377631] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.377879] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.378154] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.378407] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.378745] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.378840] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 9891c5c2-2fa5-4773-abef-3bb7dd1d522d is going to be created. [ 878.400211] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.400340] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.400380] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.400629] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.400862] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.401109] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-9891c5c2-2fa5-4773-abef-3bb7dd1d522d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.528443] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.675643] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.675800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.675875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.676115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.676211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.676315] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e812d957-e1ec-4f99-86c2-485e7c16988a is going to be updated. [ 878.702161] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.702342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.702416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.702618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.702767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.711043] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e812d957-e1ec-4f99-86c2-485e7c16988a in Status: IN_PROGRESS for 2s [ 879.030870] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.030870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.030870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.031242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.031319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.031928] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f is going to be updated. [ 879.061724] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.062072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.062244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.062575] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.062819] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.071303] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f in Status: IN_PROGRESS for 2s [ 879.120540] env[68109]: INFO networking_nsxv3.common.synchronization [req-a0b8952e-5132-4e1d-a3e9-6e0eb868544b req-d8d0027e-de6f-4516-b0f9-41cbafd9d572 service nova] Enqueued Resource ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 with Priority: HIGHEST for action security_group_rules [ 879.120716] env[68109]: INFO networking_nsxv3.common.synchronization [req-a0b8952e-5132-4e1d-a3e9-6e0eb868544b req-d8d0027e-de6f-4516-b0f9-41cbafd9d572 service nova] Enqueued Resource ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 with Priority: HIGHEST for action security_group_members [ 879.120865] env[68109]: INFO networking_nsxv3.common.synchronization [req-a0b8952e-5132-4e1d-a3e9-6e0eb868544b req-d8d0027e-de6f-4516-b0f9-41cbafd9d572 service nova] Enqueued Resource ID: 9891c5c2-2fa5-4773-abef-3bb7dd1d522d with Priority: HIGHEST for action port [ 879.122692] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 with Priority: HIGHEST for action security_group_rules [ 879.122746] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 with Priority: HIGHEST for action security_group_members [ 879.122836] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9891c5c2-2fa5-4773-abef-3bb7dd1d522d with Priority: HIGHEST for action port [ 879.123155] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-367414dc-5bb3-4cf0-b02d-c624234144c1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.123288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.123350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.124046] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.124046] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('367414dc-5bb3-4cf0-b02d-c624234144c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.124644] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-367414dc-5bb3-4cf0-b02d-c624234144c1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.124758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.124821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.125021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.125832] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.125960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.126030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.126189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.126962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.126962] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('367414dc-5bb3-4cf0-b02d-c624234144c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.127186] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-9891c5c2-2fa5-4773-abef-3bb7dd1d522d taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.127267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9891c5c2-2fa5-4773-abef-3bb7dd1d522d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.127369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9891c5c2-2fa5-4773-abef-3bb7dd1d522d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.127481] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9891c5c2-2fa5-4773-abef-3bb7dd1d522d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.127556] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9891c5c2-2fa5-4773-abef-3bb7dd1d522d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.632579] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-367414dc-5bb3-4cf0-b02d-c624234144c1 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.632768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.633039] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('367414dc-5bb3-4cf0-b02d-c624234144c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.634038] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9891c5c2-2fa5-4773-abef-3bb7dd1d522d with status ACTIVE [ 879.634287] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.634441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.634521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.634770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.634896] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.638766] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.638828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.638905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.640049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.640049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.640049] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.640049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.640049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.640049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.640049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.640469] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9891c5c2-2fa5-4773-abef-3bb7dd1d522d is going to be updated. [ 879.659896] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.660040] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.660139] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.660310] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.660474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.660664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9891c5c2-2fa5-4773-abef-3bb7dd1d522d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.142649] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('367414dc-5bb3-4cf0-b02d-c624234144c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.354654] env[68109]: INFO networking_nsxv3.common.synchronization [req-89c7660b-70eb-4838-822f-88c8fb9058a1 req-f9c51b30-e2a6-4394-9fc9-01086071a015 tempest-MultipleCreateTestJSON-181458045 tempest-MultipleCreateTestJSON-181458045-project-member] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 880.355242] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 880.355584] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.355967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.355967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.355967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.356341] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.356451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.356516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.356676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.356761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.356856] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.645453] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.645682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.645758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.649022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.649022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.649022] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 is going to be created. [ 880.668358] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.668523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.668613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.668758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.669509] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.677449] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 in Status: UNINITIALIZED for 2s [ 880.720897] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e812d957-e1ec-4f99-86c2-485e7c16988a in Status: SUCCESS [ 880.721225] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.721398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.721612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.721802] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.721918] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.721987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.722182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.722255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.722345] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.722499] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.722591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.722650] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.722788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.722923] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.723022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.723078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.723221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.723295] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.723376] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.723469] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.822282] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.822483] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.822619] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.822928] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.823491] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.823665] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.823796] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.824137] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.824297] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.824515] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 880.824637] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 880.824756] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 880.824905] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 880.825047] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 880.825184] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 880.825328] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 880.845100] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 880.845279] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 880.846087] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 880.846087] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.846087] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-db0ce8b4-ae9a-4792-b349-985066d0f7ff taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.846424] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-db0ce8b4-ae9a-4792-b349-985066d0f7ff" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.846424] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-db0ce8b4-ae9a-4792-b349-985066d0f7ff" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.846606] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-db0ce8b4-ae9a-4792-b349-985066d0f7ff" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.846752] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db0ce8b4-ae9a-4792-b349-985066d0f7ff',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.861766] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.861766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.861766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.861766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.881325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.881325] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.881325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.881325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.881325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.881325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.881325] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be updated. [ 880.903447] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.903592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.903657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.903887] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.904036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.911854] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 2s [ 881.080357] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f in Status: SUCCESS [ 881.080651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.080863] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.081125] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.081345] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.081476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.081559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.081766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.081868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.082025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.082239] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.225615] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e812d957-e1ec-4f99-86c2-485e7c16988a: rpc.has_security_group_logging(os_id): False [ 881.243716] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.243894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.243982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.244288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.244397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.244594] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.244704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.244774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.244936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.245031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.245295] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.245404] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.245464] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.245607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.245684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.245901] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.246010] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.246078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.246259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.246316] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.246472] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e812d957-e1ec-4f99-86c2-485e7c16988a is going to be created. [ 881.305607] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.305812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.305894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.306126] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.306329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.317658] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e812d957-e1ec-4f99-86c2-485e7c16988a in Status: IN_PROGRESS for 2s [ 881.349381] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.349573] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.349694] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.350025] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.350234] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.350565] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port db0ce8b4-ae9a-4792-b349-985066d0f7ff not found, creating... [ 881.351174] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.351174] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.351174] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.351339] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.351372] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.351659] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.351818] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.351938] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.352235] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.352381] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.352532] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: db0ce8b4-ae9a-4792-b349-985066d0f7ff is going to be created. [ 881.376729] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.376968] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.377115] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.377816] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.377816] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.378079] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-db0ce8b4-ae9a-4792-b349-985066d0f7ff" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.585146] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.088066] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1b52ab9-23fb-4785-af13-8d3e64d2b62f: rpc.has_security_group_logging(os_id): False [ 882.108250] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.108347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.108379] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.108587] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.108726] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.108931] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.109077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.109141] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.109518] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.109518] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.109518] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f is going to be updated. [ 882.165552] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.165808] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.165982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.166319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.166556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.178073] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f in Status: IN_PROGRESS for 2s [ 882.252522] env[68109]: INFO networking_nsxv3.common.synchronization [req-89c7660b-70eb-4838-822f-88c8fb9058a1 req-393bb6ec-eacb-479d-b6f5-b9503936e85e service nova] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_rules [ 882.252815] env[68109]: INFO networking_nsxv3.common.synchronization [req-89c7660b-70eb-4838-822f-88c8fb9058a1 req-393bb6ec-eacb-479d-b6f5-b9503936e85e service nova] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 882.252897] env[68109]: INFO networking_nsxv3.common.synchronization [req-89c7660b-70eb-4838-822f-88c8fb9058a1 req-393bb6ec-eacb-479d-b6f5-b9503936e85e service nova] Enqueued Resource ID: db0ce8b4-ae9a-4792-b349-985066d0f7ff with Priority: HIGHEST for action port [ 882.253080] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_rules [ 882.253209] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 882.253304] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db0ce8b4-ae9a-4792-b349-985066d0f7ff with Priority: HIGHEST for action port [ 882.253837] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.253964] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.254047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.254323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.254446] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.255376] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.255428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.255655] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-db0ce8b4-ae9a-4792-b349-985066d0f7ff taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.255760] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db0ce8b4-ae9a-4792-b349-985066d0f7ff" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.255824] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db0ce8b4-ae9a-4792-b349-985066d0f7ff" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.255989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db0ce8b4-ae9a-4792-b349-985066d0f7ff" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.256077] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db0ce8b4-ae9a-4792-b349-985066d0f7ff',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.686610] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 in Status: SUCCESS [ 882.686837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.687023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.687519] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.687519] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.687627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.687654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.687962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.687962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.687962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.688081] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('367414dc-5bb3-4cf0-b02d-c624234144c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.763910] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.764059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.764368] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db0ce8b4-ae9a-4792-b349-985066d0f7ff with status ACTIVE [ 882.764609] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.764690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.764759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.765016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.765115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.765339] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.765463] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.765528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.765690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.765770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.765948] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.766047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.766114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.766283] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.766324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.766410] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db0ce8b4-ae9a-4792-b349-985066d0f7ff is going to be updated. [ 882.787145] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.787284] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.787353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.787575] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.787707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.788128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db0ce8b4-ae9a-4792-b349-985066d0f7ff" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.920857] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 882.921089] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc deletion is rescheduled due to dependency. [ 882.921216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.921457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.921598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.921777] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.921891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.921950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.922157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.922236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.922328] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.191034] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-367414dc-5bb3-4cf0-b02d-c624234144c1 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.191034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.191034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.191034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.191034] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.191315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.191315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.191500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.191617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.191733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.191904] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-367414dc-5bb3-4cf0-b02d-c624234144c1 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.192053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.192118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.192419] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.192613] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.192747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.192825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.192989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.193385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.193385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.193385] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('367414dc-5bb3-4cf0-b02d-c624234144c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.329621] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e812d957-e1ec-4f99-86c2-485e7c16988a in Status: SUCCESS [ 883.329893] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.329893] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.330180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.330298] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.424385] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.696334] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 367414dc-5bb3-4cf0-b02d-c624234144c1: rpc.has_security_group_logging(os_id): False [ 883.713853] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.714034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.714220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.714530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.714669] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.714888] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.714992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.715065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.715219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.715296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.715467] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.715554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.715610] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.715747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.715818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.716013] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.716103] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.716223] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.716400] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.716479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.716560] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 is going to be created. [ 883.772824] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.773047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.773150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.773329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.773513] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.783261] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 in Status: IN_PROGRESS for 2s [ 883.832892] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.834155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.834155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.834155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.834155] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.834155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.834155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.834409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.834526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.834656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.834783] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.926215] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.190536] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f in Status: SUCCESS [ 884.190786] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.337415] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.337821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.337821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.337886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.338046] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.338129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.338194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.338404] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.338509] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.338599] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.338746] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.338839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.338900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.339059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.339194] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.339286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.339348] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.339485] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.339560] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.339652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.339748] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.428691] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.428857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.428921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.429188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.429290] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.429381] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be updated. [ 884.457181] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.457330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.457401] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.457610] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.457751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.465389] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 2s [ 884.842181] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e812d957-e1ec-4f99-86c2-485e7c16988a: rpc.has_security_group_logging(os_id): False [ 884.860606] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.860606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.860606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.860606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.860606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.860869] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.860869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.860935] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.862159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.862159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.862159] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.862159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.862159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.862159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.862159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.862159] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.862159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.862159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.862533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.862533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.862533] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e812d957-e1ec-4f99-86c2-485e7c16988a is going to be updated. [ 884.920077] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.920267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.920267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.920468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.920612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.931387] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e812d957-e1ec-4f99-86c2-485e7c16988a in Status: IN_PROGRESS for 2s [ 884.968979] env[68109]: INFO networking_nsxv3.common.synchronization [req-89c7660b-70eb-4838-822f-88c8fb9058a1 req-240a12d5-8d01-4d3b-a4fb-01e71365b458 tempest-MultipleCreateTestJSON-181458045 tempest-MultipleCreateTestJSON-181458045-project-member] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 884.969939] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 884.970065] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.970365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.523055] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.523055] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.523055] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.523055] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.523055] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.523055] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.523055] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.523572] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.523877] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.524241] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.524609] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.525132] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.526587] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.526587] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.526587] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.526587] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.547129] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.547129] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 885.547129] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.547129] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-885" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.547129] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-130374cf-75a7-4de2-857a-e3da904e8288 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.547129] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-130374cf-75a7-4de2-857a-e3da904e8288" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.547129] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-130374cf-75a7-4de2-857a-e3da904e8288" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.547129] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-130374cf-75a7-4de2-857a-e3da904e8288" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.547998] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('130374cf-75a7-4de2-857a-e3da904e8288',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.793168] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 in Status: SUCCESS [ 885.793456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.051037] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.051037] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.051248] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.051456] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.051676] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.051875] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 130374cf-75a7-4de2-857a-e3da904e8288 not found, creating... [ 886.052164] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.052351] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.052478] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.052731] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.052879] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.053203] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.053378] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.053513] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.053755] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.053902] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.054068] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 130374cf-75a7-4de2-857a-e3da904e8288 is going to be created. [ 886.073623] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.073860] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.074042] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.074454] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.074699] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.074989] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-130374cf-75a7-4de2-857a-e3da904e8288" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.475555] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 886.475841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.476090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.476398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.476487] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.476630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.476697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.476858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.476946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.477037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.477295] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.478700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.478700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.478700] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.478873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.478873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.479018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.479100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.479238] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.947603] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e812d957-e1ec-4f99-86c2-485e7c16988a in Status: SUCCESS [ 886.947943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.981493] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.981809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.981959] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.040798] env[68109]: INFO networking_nsxv3.common.synchronization [req-89c7660b-70eb-4838-822f-88c8fb9058a1 req-f1a8e204-1ce9-4c47-8843-ff517dec3521 service nova] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_rules [ 887.040974] env[68109]: INFO networking_nsxv3.common.synchronization [req-89c7660b-70eb-4838-822f-88c8fb9058a1 req-f1a8e204-1ce9-4c47-8843-ff517dec3521 service nova] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 887.041123] env[68109]: INFO networking_nsxv3.common.synchronization [req-89c7660b-70eb-4838-822f-88c8fb9058a1 req-f1a8e204-1ce9-4c47-8843-ff517dec3521 service nova] Enqueued Resource ID: 130374cf-75a7-4de2-857a-e3da904e8288 with Priority: HIGHEST for action port [ 887.041859] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_rules [ 887.042277] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 887.042431] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 130374cf-75a7-4de2-857a-e3da904e8288 with Priority: HIGHEST for action port [ 887.043075] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.043075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.043075] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.043251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.044386] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-130374cf-75a7-4de2-857a-e3da904e8288 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.044386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-130374cf-75a7-4de2-857a-e3da904e8288" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.044386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-130374cf-75a7-4de2-857a-e3da904e8288" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.044386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-130374cf-75a7-4de2-857a-e3da904e8288" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.044386] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('130374cf-75a7-4de2-857a-e3da904e8288',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.483931] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.546538] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 130374cf-75a7-4de2-857a-e3da904e8288 with status ACTIVE [ 887.548030] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.548030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.548030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.548030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.548030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.548030] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.548030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.548030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.548030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.548030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.548030] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.548578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.548578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.548578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.548578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.548578] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 130374cf-75a7-4de2-857a-e3da904e8288 is going to be updated. [ 887.568662] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.568794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.569039] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.569214] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.569425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.569686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-130374cf-75a7-4de2-857a-e3da904e8288" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.987106] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.987965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.987965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.987965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.987965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.987965] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be updated. [ 888.015421] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.015421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.015421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.015721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.015775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.025969] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 2s [ 890.036449] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 890.036765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.036963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.037125] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.037317] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.037548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.037548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.037683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.037761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.037848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.038015] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.038118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.038185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.038330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.038486] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.038582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.038643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.038886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.038886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.038962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.039016] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.043061] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.043327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.043545] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.043716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.043837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.044049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.044261] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.044359] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.548735] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 327a22ab-0003-41d7-851d-6eba37a2b9dc: rpc.has_security_group_logging(os_id): False [ 890.548735] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.571043] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.571043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.571043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.571043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.571043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.571043] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.571043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.571043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.571043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.571043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.571043] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.571043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.571043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.571043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.571043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.571561] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.571857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.572056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.572290] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.572456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.572619] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be updated. [ 890.629588] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.631454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.631454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.631454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.631454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.646856] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 2s [ 891.056017] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.556302] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.556515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.556654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.556771] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.556830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.557136] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be updated. [ 891.581859] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.582238] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.582238] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.582467] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.582554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.591369] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 2s [ 892.043649] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 892.043814] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 892.667526] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 892.667791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.667970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.668169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.668260] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.970771] env[68109]: INFO networking_nsxv3.common.synchronization [req-5d6ba6b4-dcb5-48c7-a7fa-67f370132cc4 req-c49ccf93-f126-4de5-964b-d48635cf64ea tempest-ServerMetadataTestJSON-1086564351 tempest-ServerMetadataTestJSON-1086564351-project-member] Enqueued Resource ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 with Priority: HIGHEST for action security_group_members [ 892.971325] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 with Priority: HIGHEST for action security_group_members [ 892.971652] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-367414dc-5bb3-4cf0-b02d-c624234144c1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.971777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.971842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.972162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.972330] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.972434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.972496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.972655] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.972734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.972830] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('367414dc-5bb3-4cf0-b02d-c624234144c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.178369] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.178369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.475710] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.475872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.476439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.476439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.476439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.476577] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.476577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.476699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.476751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.476825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.476912] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 is going to be updated. [ 893.501450] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.501450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.501450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.501666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.501818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.510013] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 in Status: IN_PROGRESS for 2s [ 893.601399] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 4s [ 895.519801] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 in Status: SUCCESS [ 895.520062] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 367414dc-5bb3-4cf0-b02d-c624234144c1 deletion is rescheduled due to dependency. [ 895.520111] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-367414dc-5bb3-4cf0-b02d-c624234144c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.616664] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 895.616664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.616664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.616979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.617173] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.617309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.617393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.617546] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.617629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.617716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.617808] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.120070] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.120303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.120373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.120612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.120806] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.120909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.120973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.122216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.122216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.122216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.122216] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.122216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.122216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.122216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.122216] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.122216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.122216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.122216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.122792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.122792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.122792] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.232024] env[68109]: INFO networking_nsxv3.common.synchronization [req-bda34603-e367-4de5-94f3-7cb0d63f7efc req-e3007399-cfd1-44cb-8cb0-d636383d3a71 tempest-DeleteServersTestJSON-2063667557 tempest-DeleteServersTestJSON-2063667557-project-member] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 896.232024] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 896.232024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.232024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.232024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.232024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.232024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.232696] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.232982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.233305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.233495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.233693] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.625777] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 327a22ab-0003-41d7-851d-6eba37a2b9dc: rpc.has_security_group_logging(os_id): False [ 896.642887] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.643116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.643236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.643505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.643638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.643924] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.644088] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.644203] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.644414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.644539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.644789] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.644941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.648109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.648342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.648475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.648756] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.648914] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.649032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.649239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.649363] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.649502] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be updated. [ 896.713867] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.714092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.714092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.714413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.714601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.729393] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 2s [ 896.735976] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.736159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.736276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.736556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.757047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.757317] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.757426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.757494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.757721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.757800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.757890] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 896.805364] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.805566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.805627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.805828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.805987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.815746] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 898.744275] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 898.744598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.824307] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 898.824528] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 deletion is rescheduled due to dependency. [ 898.824654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.697140] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.697357] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.697493] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.697824] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.698105] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.698224] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.698352] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.698551] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.698746] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.699015] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.699593] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.699747] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.699868] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.699994] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.700121] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.700264] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.723366] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.723658] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.723783] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.724018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.724398] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.724826] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.724826] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.725304] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.725630] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.229223] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.229223] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.229223] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.229223] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.229223] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.229866] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.229866] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.229866] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.229866] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.230028] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.230720] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.230720] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.230720] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.230720] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.231088] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.231088] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 is going to be updated. [ 900.260472] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.260737] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.260874] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.261207] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.261469] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.261743] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.231847] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 901.232113] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 901.265438] env[68109]: INFO networking_nsxv3.common.synchronization [req-c8ad69c5-8709-4880-9c0f-2d45e734a2c5 req-e07211cd-8161-4b1a-a8aa-a954d753cd75 service nova] Enqueued Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_rules [ 901.265610] env[68109]: INFO networking_nsxv3.common.synchronization [req-c8ad69c5-8709-4880-9c0f-2d45e734a2c5 req-e07211cd-8161-4b1a-a8aa-a954d753cd75 service nova] Enqueued Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_members [ 901.265763] env[68109]: INFO networking_nsxv3.common.synchronization [req-c8ad69c5-8709-4880-9c0f-2d45e734a2c5 req-e07211cd-8161-4b1a-a8aa-a954d753cd75 service nova] Enqueued Resource ID: f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 with Priority: HIGHEST for action port [ 901.265987] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_rules [ 901.266593] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_members [ 901.266593] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 with Priority: HIGHEST for action port [ 901.267149] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50bf3a02-de03-46e5-a1de-389d8f706b9b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.267430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.267430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.267555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.267638] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.268507] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-50bf3a02-de03-46e5-a1de-389d8f706b9b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.269095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.269095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.269095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.269095] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.269327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.269327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.269327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.269413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.269479] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.273986] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.275665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.275665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.275665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.275865] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.299676] env[68109]: INFO networking_nsxv3.common.synchronization [req-f562eef9-a95f-48a7-b750-e19244580449 req-e44acb3b-b363-4a0d-b0c6-406c3bc5df74 tempest-MultipleCreateTestJSON-181458045 tempest-MultipleCreateTestJSON-181458045-project-member] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 901.300610] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 901.301515] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.301515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.301515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.301515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.301515] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.301754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.301754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.301851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.301968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.302492] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.328129] env[68109]: INFO networking_nsxv3.common.synchronization [req-b31b4d33-db61-4d69-aa5b-cdf92703d00e req-47c0beee-b145-453d-a5f1-87e86d1bf1e2 tempest-MultipleCreateTestJSON-181458045 tempest-MultipleCreateTestJSON-181458045-project-member] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 901.328825] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGHEST for action security_group_members [ 901.329937] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.330158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.778133] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-50bf3a02-de03-46e5-a1de-389d8f706b9b taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.778276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.778509] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 with status ACTIVE [ 901.778685] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.778780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.778844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.779062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.779152] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.779329] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.779428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.779492] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.779638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.779713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.779889] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.779976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.780049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.780329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.780411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.780497] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47 is going to be updated. [ 901.781629] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.804900] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.805045] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.805093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.805305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.805416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.805812] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.805812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.805812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.805981] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.805981] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.806895] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be updated. [ 901.810065] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.810284] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.810366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.810527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.810659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.810807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5e9bfe3-8211-4c77-95ff-f0c0c6bbfd47" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.836932] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.837104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.837169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.837448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.837518] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.849962] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 2s [ 902.288206] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.793191] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.793731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.793731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.793731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.793731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.793973] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b is going to be updated. [ 902.823690] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.823843] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.823911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.824200] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.824326] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.832575] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b in Status: IN_PROGRESS for 2s [ 903.860553] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 903.860553] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc deletion is rescheduled due to dependency. [ 903.860553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.860553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.860553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.860553] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.860553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.860553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.860553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.860553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.860553] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.241507] env[68109]: INFO networking_nsxv3.common.synchronization [None req-4c4f4ffd-23bc-4f19-8013-b0bd3bb75516 None None] Enqueued Resource ID: fab15eb3-b23d-43f5-8b21-0e9b05513e3b with Priority: HIGHEST for action port [ 904.241777] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab15eb3-b23d-43f5-8b21-0e9b05513e3b with Priority: HIGHEST for action port [ 904.246117] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-fab15eb3-b23d-43f5-8b21-0e9b05513e3b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.250032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fab15eb3-b23d-43f5-8b21-0e9b05513e3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.250032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fab15eb3-b23d-43f5-8b21-0e9b05513e3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.250032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fab15eb3-b23d-43f5-8b21-0e9b05513e3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.250032] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fab15eb3-b23d-43f5-8b21-0e9b05513e3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.364180] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.367609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.367609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.367609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.367609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.367609] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.367609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.367609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.367609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.367609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.367609] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be updated. [ 904.391070] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.391228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.391300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.391501] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.391675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.401810] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: IN_PROGRESS for 2s [ 904.753325] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fab15eb3-b23d-43f5-8b21-0e9b05513e3b [ 904.753596] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.753681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.753750] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.753968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.754071] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.754172] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fab15eb3-b23d-43f5-8b21-0e9b05513e3b already deleted. [ 904.754253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fab15eb3-b23d-43f5-8b21-0e9b05513e3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.844096] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b in Status: SUCCESS [ 904.844096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.844096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.844273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.844499] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.844671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.844765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.844957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.845065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.845160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.845257] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.347046] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.853191] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50bf3a02-de03-46e5-a1de-389d8f706b9b: rpc.has_security_group_logging(os_id): False [ 905.873020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.873020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.873020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.873020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.873020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.873020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.873020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.873020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.873020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.873020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.873020] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b is going to be created. [ 905.951852] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.952067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.952217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.952478] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.952672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.976755] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b in Status: IN_PROGRESS for 2s [ 906.412111] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc in Status: SUCCESS [ 906.412111] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc deletion is rescheduled due to dependency. [ 906.412111] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.615299] env[68109]: INFO networking_nsxv3.common.synchronization [None req-cd3127c0-069a-4f3a-bc1c-ec04fc9234a6 None None] Enqueued Resource ID: 1f5b3209-9a6e-42ab-bae4-a8dbb338f852 with Priority: HIGHEST for action port [ 906.615299] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f5b3209-9a6e-42ab-bae4-a8dbb338f852 with Priority: HIGHEST for action port [ 906.615299] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f5b3209-9a6e-42ab-bae4-a8dbb338f852 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.615299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f5b3209-9a6e-42ab-bae4-a8dbb338f852" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.615504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f5b3209-9a6e-42ab-bae4-a8dbb338f852" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.616057] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f5b3209-9a6e-42ab-bae4-a8dbb338f852" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.616057] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f5b3209-9a6e-42ab-bae4-a8dbb338f852',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.118749] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f5b3209-9a6e-42ab-bae4-a8dbb338f852 [ 907.119096] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.119276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.119416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.119627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.119722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.119818] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f5b3209-9a6e-42ab-bae4-a8dbb338f852 already deleted. [ 907.119899] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f5b3209-9a6e-42ab-bae4-a8dbb338f852" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.000161] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b in Status: SUCCESS [ 908.000537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.583278] env[68109]: INFO networking_nsxv3.common.synchronization [None req-782268de-33a8-4a3a-a79b-85c3cbf8a9f0 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 with Priority: HIGHEST for action security_group_rules [ 908.587376] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 with Priority: HIGHEST for action security_group_rules [ 908.587376] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15c24162-8d2d-427e-9b29-f175f91a92c1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.587599] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.587599] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.587801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.587883] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15c24162-8d2d-427e-9b29-f175f91a92c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.681479] env[68109]: INFO networking_nsxv3.common.synchronization [None req-0e8d4d2b-e555-41b6-9dd3-d2b6bca14387 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 with Priority: HIGHEST for action security_group_rules [ 908.681479] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 with Priority: HIGHEST for action security_group_rules [ 908.681479] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15c24162-8d2d-427e-9b29-f175f91a92c1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.681479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.108536] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.108882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.108882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.109259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.109259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.109259] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 already deleted. [ 909.109259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.109382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.109479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.109568] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15c24162-8d2d-427e-9b29-f175f91a92c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.630218] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.630338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.630338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.630567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.630660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.630760] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 already deleted. [ 909.630841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.423373] env[68109]: INFO networking_nsxv3.common.synchronization [req-da6ae910-1ca2-4697-9b12-bfba7c7b153a req-984d232e-3287-413d-b67e-c72bfded8c90 tempest-InstanceActionsNegativeTestJSON-800350012 tempest-InstanceActionsNegativeTestJSON-800350012-project-member] Enqueued Resource ID: ea631704-7b9c-465d-b911-2ef8b25de4cb with Priority: HIGHEST for action security_group_members [ 910.423985] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea631704-7b9c-465d-b911-2ef8b25de4cb with Priority: HIGHEST for action security_group_members [ 910.424684] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea631704-7b9c-465d-b911-2ef8b25de4cb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.424684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.424684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.424926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.425091] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.425196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.425260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.425463] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.425557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.425656] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea631704-7b9c-465d-b911-2ef8b25de4cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.880385] env[68109]: INFO networking_nsxv3.common.synchronization [req-8d5580d5-ab7d-4478-ab46-cacda8c8e61e req-157e78cf-4db2-49d7-9bf7-0318331196b4 tempest-ListServerFiltersTestJSON-53590806 tempest-ListServerFiltersTestJSON-53590806-project-member] Enqueued Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 910.881677] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGHEST for action security_group_members [ 910.882161] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.882345] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.882459] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.882684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.883909] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.883909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.883909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.883909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.883909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.883909] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.888443] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.888443] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-943" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.888443] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-943" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.888443] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-943" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.888443] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.888443] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.888752] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.888819] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.889026] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.889376] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.889497] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.889626] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.889810] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.889966] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.890103] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.890263] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.912154] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.912154] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 910.912406] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.912534] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-943" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.912824] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-7bc960a4-4ac8-47b9-8820-e428b65af219 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.913029] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-7bc960a4-4ac8-47b9-8820-e428b65af219" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.913188] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-7bc960a4-4ac8-47b9-8820-e428b65af219" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.913538] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-7bc960a4-4ac8-47b9-8820-e428b65af219" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.913684] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bc960a4-4ac8-47b9-8820-e428b65af219',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.928239] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.928882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.928882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.928882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.928882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.929223] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.929223] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.929223] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.930100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.930100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.930100] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea631704-7b9c-465d-b911-2ef8b25de4cb already deleted. [ 910.930100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.386954] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.387151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.387785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.387785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.406970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.407253] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.407445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.407445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.407653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.407743] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.407850] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 is going to be updated. [ 911.420633] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.420820] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.420972] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.421273] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.421431] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.421644] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 7bc960a4-4ac8-47b9-8820-e428b65af219 not found, creating... [ 911.422062] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.422244] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.422368] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.422626] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.422826] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.423297] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.423646] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.423966] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.424171] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.424367] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.424558] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 7bc960a4-4ac8-47b9-8820-e428b65af219 is going to be created. [ 911.433323] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.433512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.433595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.433925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.434102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.443027] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: IN_PROGRESS for 2s [ 911.444188] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.444516] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.444658] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.444934] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.445184] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.445571] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-7bc960a4-4ac8-47b9-8820-e428b65af219" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.159480] env[68109]: INFO networking_nsxv3.common.synchronization [req-da6ae910-1ca2-4697-9b12-bfba7c7b153a req-70d18862-6948-44b0-85f2-933f5946092e service nova] Enqueued Resource ID: ea631704-7b9c-465d-b911-2ef8b25de4cb with Priority: HIGHEST for action security_group_rules [ 912.159713] env[68109]: INFO networking_nsxv3.common.synchronization [req-da6ae910-1ca2-4697-9b12-bfba7c7b153a req-70d18862-6948-44b0-85f2-933f5946092e service nova] Enqueued Resource ID: ea631704-7b9c-465d-b911-2ef8b25de4cb with Priority: HIGHEST for action security_group_members [ 912.159871] env[68109]: INFO networking_nsxv3.common.synchronization [req-da6ae910-1ca2-4697-9b12-bfba7c7b153a req-70d18862-6948-44b0-85f2-933f5946092e service nova] Enqueued Resource ID: 7bc960a4-4ac8-47b9-8820-e428b65af219 with Priority: HIGHEST for action port [ 912.160583] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea631704-7b9c-465d-b911-2ef8b25de4cb with Priority: HIGHEST for action security_group_rules [ 912.160778] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea631704-7b9c-465d-b911-2ef8b25de4cb with Priority: HIGHEST for action security_group_members [ 912.160966] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bc960a4-4ac8-47b9-8820-e428b65af219 with Priority: HIGHEST for action port [ 912.161345] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea631704-7b9c-465d-b911-2ef8b25de4cb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.161535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.161634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.161916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.162053] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea631704-7b9c-465d-b911-2ef8b25de4cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.163152] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea631704-7b9c-465d-b911-2ef8b25de4cb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.163351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.163448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.163687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.163894] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.164091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.164091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.164371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.164488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.164613] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea631704-7b9c-465d-b911-2ef8b25de4cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.166665] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bc960a4-4ac8-47b9-8820-e428b65af219 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.168880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bc960a4-4ac8-47b9-8820-e428b65af219" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.168880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bc960a4-4ac8-47b9-8820-e428b65af219" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.170067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bc960a4-4ac8-47b9-8820-e428b65af219" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.170067] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bc960a4-4ac8-47b9-8820-e428b65af219',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.667226] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea631704-7b9c-465d-b911-2ef8b25de4cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.672305] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea631704-7b9c-465d-b911-2ef8b25de4cb taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.672305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.672486] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7bc960a4-4ac8-47b9-8820-e428b65af219 with status ACTIVE [ 912.672667] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.672819] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.672907] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.673614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.673614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.673614] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.673614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.673614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.673807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.673834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.674069] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.674170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.674231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.674415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.674492] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.674581] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7bc960a4-4ac8-47b9-8820-e428b65af219 is going to be updated. [ 912.694177] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.694438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.694487] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.694689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.694837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.694998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bc960a4-4ac8-47b9-8820-e428b65af219" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.169435] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea631704-7b9c-465d-b911-2ef8b25de4cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.452285] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 in Status: SUCCESS [ 913.452285] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 deletion is rescheduled due to dependency. [ 913.452285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.672331] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.672331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.672670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.672670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.672989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.672989] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea631704-7b9c-465d-b911-2ef8b25de4cb is going to be created. [ 913.695528] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.695781] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.695781] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.695890] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.696056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.705545] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea631704-7b9c-465d-b911-2ef8b25de4cb in Status: UNINITIALIZED for 2s [ 915.719022] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea631704-7b9c-465d-b911-2ef8b25de4cb in Status: SUCCESS [ 915.719022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.719022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.719022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.719022] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.719022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.719022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.719022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.719022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.719022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.719022] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea631704-7b9c-465d-b911-2ef8b25de4cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.220257] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea631704-7b9c-465d-b911-2ef8b25de4cb taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.220434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.220510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.220784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.221037] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.221208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.221208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.221360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.221449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.221554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.221675] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea631704-7b9c-465d-b911-2ef8b25de4cb taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.222244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.222244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.222244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.222244] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.222244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.222244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.222485] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.222485] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.222537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.222962] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea631704-7b9c-465d-b911-2ef8b25de4cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.725198] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea631704-7b9c-465d-b911-2ef8b25de4cb: rpc.has_security_group_logging(os_id): False [ 916.744152] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.744253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.744330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.744578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.744737] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.744884] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.744987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.745107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.745207] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.745273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.745495] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.745585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.745660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.745778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.747037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.747037] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.747037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.747037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.747037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.747037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.747037] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea631704-7b9c-465d-b911-2ef8b25de4cb is going to be created. [ 916.840659] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.840834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.841197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.841456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.841702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.852844] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea631704-7b9c-465d-b911-2ef8b25de4cb in Status: IN_PROGRESS for 2s [ 916.941137] env[68109]: INFO networking_nsxv3.common.synchronization [req-79842ff3-412e-4ff7-9d8e-a83cff54237a req-692e48a9-5d52-4ec1-94f6-ceac57e6ce86 tempest-ImagesTestJSON-447768907 tempest-ImagesTestJSON-447768907-project-member] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 916.941665] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 916.941970] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.942108] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.942172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.942394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.942907] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.943032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.943103] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.943265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.943351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.943468] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.261984] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.262248] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.262440] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.262771] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.263102] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.263325] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.263470] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.263726] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.263920] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.264199] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.264390] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.264509] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.264646] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.264800] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.264938] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.265131] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.284178] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.284178] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 917.284381] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.284546] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.284783] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-b7b6266e-8622-4ff5-8f33-c7e7bba45ab8 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.284969] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-b7b6266e-8622-4ff5-8f33-c7e7bba45ab8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.285104] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-b7b6266e-8622-4ff5-8f33-c7e7bba45ab8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.285470] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-b7b6266e-8622-4ff5-8f33-c7e7bba45ab8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.285647] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7b6266e-8622-4ff5-8f33-c7e7bba45ab8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.446086] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.446305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.446379] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.446597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.446709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.446927] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.447060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.447133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.447328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.447419] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.447515] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be updated. [ 917.475428] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.475585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.475656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.475891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.476067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.484244] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 917.788616] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.789025] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.789025] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.789341] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.789491] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.789712] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port b7b6266e-8622-4ff5-8f33-c7e7bba45ab8 not found, creating... [ 917.790026] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.790201] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.790358] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.792423] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.792546] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.792925] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.793140] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.793282] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.793578] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.793715] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.793843] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: b7b6266e-8622-4ff5-8f33-c7e7bba45ab8 is going to be created. [ 917.816911] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.817172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.817289] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.817603] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.817866] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.818131] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-b7b6266e-8622-4ff5-8f33-c7e7bba45ab8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.654645] env[68109]: INFO networking_nsxv3.common.synchronization [req-79842ff3-412e-4ff7-9d8e-a83cff54237a req-dbc1b483-c32e-4bfe-9d88-68ca82597a4d service nova] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_rules [ 918.654827] env[68109]: INFO networking_nsxv3.common.synchronization [req-79842ff3-412e-4ff7-9d8e-a83cff54237a req-dbc1b483-c32e-4bfe-9d88-68ca82597a4d service nova] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 918.654971] env[68109]: INFO networking_nsxv3.common.synchronization [req-79842ff3-412e-4ff7-9d8e-a83cff54237a req-dbc1b483-c32e-4bfe-9d88-68ca82597a4d service nova] Enqueued Resource ID: b7b6266e-8622-4ff5-8f33-c7e7bba45ab8 with Priority: HIGHEST for action port [ 918.655453] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_rules [ 918.655537] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 918.655588] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7b6266e-8622-4ff5-8f33-c7e7bba45ab8 with Priority: HIGHEST for action port [ 918.656189] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.656322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.656389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.656611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.656724] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.657584] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.657680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.657873] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7b6266e-8622-4ff5-8f33-c7e7bba45ab8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.657971] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7b6266e-8622-4ff5-8f33-c7e7bba45ab8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.658050] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7b6266e-8622-4ff5-8f33-c7e7bba45ab8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.658213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7b6266e-8622-4ff5-8f33-c7e7bba45ab8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.658288] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7b6266e-8622-4ff5-8f33-c7e7bba45ab8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.863878] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea631704-7b9c-465d-b911-2ef8b25de4cb in Status: SUCCESS [ 918.864183] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.160463] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.160601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.160811] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7b6266e-8622-4ff5-8f33-c7e7bba45ab8 with status ACTIVE [ 919.160983] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.161116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.161183] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.161402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.161495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.161663] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.161759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.161823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.161987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.162067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.162253] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.162379] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.162454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.162614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.162678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.162815] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7b6266e-8622-4ff5-8f33-c7e7bba45ab8 is going to be updated. [ 919.184025] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.184025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.184025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.184025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.184025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.184025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7b6266e-8622-4ff5-8f33-c7e7bba45ab8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.494715] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 919.494715] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 deletion is rescheduled due to dependency. [ 919.495105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.495105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.495257] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.495568] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.495744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.495782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.495945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.496043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.496148] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.999061] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.500969] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.004022] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.004530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.004530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.004640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.004703] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.004811] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be updated. [ 921.032884] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.033041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.033114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.033322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.033470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.043380] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 921.870165] env[68109]: INFO networking_nsxv3.common.synchronization [None req-f3137ae2-2b18-4f8c-a07b-814970c880c1 tempest-ServerDiskConfigTestJSON-1064584538 tempest-ServerDiskConfigTestJSON-1064584538-project-member] Enqueued Resource ID: f6f120ce-7084-44d5-a56c-f2e4d03e2660 with Priority: HIGHEST for action security_group_rules [ 921.870351] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f120ce-7084-44d5-a56c-f2e4d03e2660 with Priority: HIGHEST for action security_group_rules [ 921.870536] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6f120ce-7084-44d5-a56c-f2e4d03e2660 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.870665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6f120ce-7084-44d5-a56c-f2e4d03e2660" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.870730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6f120ce-7084-44d5-a56c-f2e4d03e2660" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.870992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6f120ce-7084-44d5-a56c-f2e4d03e2660" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.871280] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6f120ce-7084-44d5-a56c-f2e4d03e2660',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.995331] env[68109]: INFO networking_nsxv3.common.synchronization [None req-c16f4ae1-4a29-4fae-b9a1-eae2ac8cefb9 tempest-ServerDiskConfigTestJSON-1064584538 tempest-ServerDiskConfigTestJSON-1064584538-project-member] Enqueued Resource ID: f6f120ce-7084-44d5-a56c-f2e4d03e2660 with Priority: HIGHEST for action security_group_rules [ 921.996018] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f120ce-7084-44d5-a56c-f2e4d03e2660 with Priority: HIGHEST for action security_group_rules [ 921.996354] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6f120ce-7084-44d5-a56c-f2e4d03e2660 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.996724] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6f120ce-7084-44d5-a56c-f2e4d03e2660" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.390323] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.390684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.390684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.390764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.390796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.390892] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6f120ce-7084-44d5-a56c-f2e4d03e2660 already deleted. [ 922.390976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6f120ce-7084-44d5-a56c-f2e4d03e2660" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.391141] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6f120ce-7084-44d5-a56c-f2e4d03e2660" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.391297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6f120ce-7084-44d5-a56c-f2e4d03e2660" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.391382] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6f120ce-7084-44d5-a56c-f2e4d03e2660',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.910077] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.910254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.910322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.910569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.910658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.910767] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6f120ce-7084-44d5-a56c-f2e4d03e2660 already deleted. [ 922.910865] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6f120ce-7084-44d5-a56c-f2e4d03e2660" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.054691] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 923.054885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.058025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.058025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.058025] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.058025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.058025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.058025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.058025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.058025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.058025] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.386949] env[68109]: INFO networking_nsxv3.common.synchronization [req-19b75eef-556a-4482-ad04-482ce899bf31 req-77ca2d17-1996-4065-aca8-efe5613800b3 tempest-InstanceActionsNegativeTestJSON-800350012 tempest-InstanceActionsNegativeTestJSON-800350012-project-member] Enqueued Resource ID: ea631704-7b9c-465d-b911-2ef8b25de4cb with Priority: HIGHEST for action security_group_members [ 923.387214] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea631704-7b9c-465d-b911-2ef8b25de4cb with Priority: HIGHEST for action security_group_members [ 923.387520] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea631704-7b9c-465d-b911-2ef8b25de4cb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.389025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.389025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.389025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.389025] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.389025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.389025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.389296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.389296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.389296] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea631704-7b9c-465d-b911-2ef8b25de4cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.562049] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.562049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.562049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.562049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.562049] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.562049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.562049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.562049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.562049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.562049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.562049] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.562049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.562049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.562049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.562049] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.562049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.562839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.562839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.562839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.562839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.562839] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.893090] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.893275] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.893342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.893565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.893658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.893868] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.893943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.894020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.894173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.894243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.894330] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea631704-7b9c-465d-b911-2ef8b25de4cb is going to be updated. [ 923.918061] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.918287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.918332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.918540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.918730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.926814] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea631704-7b9c-465d-b911-2ef8b25de4cb in Status: IN_PROGRESS for 2s [ 924.064028] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bd26aad-19e8-435d-b39a-5875f3b5cfd7: rpc.has_security_group_logging(os_id): False [ 924.082373] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.082592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.082592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.082853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.082936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.083134] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.083375] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.083375] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.083632] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.083736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.083956] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.084071] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.084144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.084313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.084405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.084702] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.084811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.084876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.085129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.085129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.085206] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be updated. [ 924.236011] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.236011] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.236011] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.236011] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.236287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.249663] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 925.657691] env[68109]: INFO networking_nsxv3.common.synchronization [req-a857cb2a-d7af-4e9d-829b-d1078d9b723f req-080a95cc-a25c-4a1b-bf24-bc432cdf338e tempest-ServerDiskConfigTestJSON-1064584538 tempest-ServerDiskConfigTestJSON-1064584538-project-member] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 925.659246] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 925.659590] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.659781] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.659781] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.660081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.660197] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.660320] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.660320] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.660493] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.660576] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.661856] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.943106] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea631704-7b9c-465d-b911-2ef8b25de4cb in Status: SUCCESS [ 925.943106] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea631704-7b9c-465d-b911-2ef8b25de4cb deletion is rescheduled due to dependency. [ 925.943106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.168030] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.168186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.168186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.168337] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.188839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.189262] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.189464] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.189589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.189916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.190026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.190292] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 926.215237] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.215237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.215237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.215489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.215489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.223481] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 926.269529] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 926.269739] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.683343] env[68109]: INFO networking_nsxv3.common.synchronization [req-2e83d18a-55d9-410f-a512-31bd979b81c8 req-945d6dad-b864-4604-98fb-a458d66575aa tempest-DeleteServersTestJSON-2063667557 tempest-DeleteServersTestJSON-2063667557-project-member] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 926.684706] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 926.685074] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.685209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.685276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.685466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.685632] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.685742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.685777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.685926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.686021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.686116] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.989427] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-505 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.989593] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.989683] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.989953] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.990236] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.990455] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.990601] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.990889] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.991507] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.991625] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.991754] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 926.991872] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 926.992722] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 926.992722] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.992722] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 926.992722] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.010853] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.011041] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 927.011186] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.011360] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.011683] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.011863] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.011988] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.012358] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.012534] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.188686] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.189069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.189251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.189663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.189797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.190197] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.190329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.190402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.190683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.190858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.190962] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 927.214626] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.214800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.214838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.215115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.215264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.223442] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 927.515367] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.515619] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.515755] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.516051] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.516215] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.516378] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec not found, creating... [ 927.516650] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.516828] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.516959] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.517208] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.517351] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.517864] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.517864] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.517995] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.518145] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.518288] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.518435] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec is going to be created. [ 927.537737] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.538051] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.539035] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.539035] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.539035] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.539035] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.232928] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 928.233367] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 deletion is rescheduled due to dependency. [ 928.233367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.298338] env[68109]: INFO networking_nsxv3.common.synchronization [req-2e83d18a-55d9-410f-a512-31bd979b81c8 req-f5b09555-b610-4950-be94-3a3337d1ddee service nova] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_rules [ 928.298542] env[68109]: INFO networking_nsxv3.common.synchronization [req-2e83d18a-55d9-410f-a512-31bd979b81c8 req-f5b09555-b610-4950-be94-3a3337d1ddee service nova] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 928.298729] env[68109]: INFO networking_nsxv3.common.synchronization [req-2e83d18a-55d9-410f-a512-31bd979b81c8 req-f5b09555-b610-4950-be94-3a3337d1ddee service nova] Enqueued Resource ID: d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec with Priority: HIGHEST for action port [ 928.299481] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_rules [ 928.299681] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 928.299898] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec with Priority: HIGHEST for action port [ 928.300291] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.300500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.300788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.301238] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.301337] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.303777] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.303899] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.304776] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.304900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.304986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.305247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.305355] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.808506] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.809140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.809140] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec with status ACTIVE [ 928.809140] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.809319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.809319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.809509] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.809596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.809766] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.810109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.810109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.810109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.810236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.810328] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.810434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.810495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.810639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.810725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.810811] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec is going to be updated. [ 928.831431] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.831570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.831650] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.832224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.832224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.832224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4ed9b4b-fb99-4dfe-ab3e-68c6065e78ec" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.233329] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 929.233624] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 deletion is rescheduled due to dependency. [ 929.233742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.233945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.234180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.234368] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.234516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.234588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.235042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.235042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.235042] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.738032] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.240312] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.743134] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.743434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.743539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.743830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.743954] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.744105] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 930.772316] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.772515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.772593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.772830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.772981] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.780845] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 932.792051] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 932.792344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.792394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.793104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.793104] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.793254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.793254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.793411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.793507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.793638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.793743] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.297531] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.297531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.297531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.297531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.297810] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.297889] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.297921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.298104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.298256] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.298376] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.298544] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.298635] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.298698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.298864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.299056] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.299117] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.299167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.299310] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.299399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.299461] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.299553] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.300500] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 933.300580] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 933.803492] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3775fbff-3109-41e9-a7b4-71b12133d9f0: rpc.has_security_group_logging(os_id): False [ 933.822800] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.823075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.823294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.823431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.823528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.823878] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.824121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.824191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.824356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.824439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.824739] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.824861] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.825015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.825412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.825509] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.825845] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.826150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.826150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.826264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.826294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.827253] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 933.899184] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.899376] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.899420] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.899605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.899757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.912446] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 934.963658] env[68109]: INFO networking_nsxv3.common.synchronization [None req-ade10ff2-5fe2-4631-817e-0b85154f9ef4 None None] Enqueued Resource ID: 8d8966b3-0df4-4687-b824-af52ed7c3d17 with Priority: HIGHEST for action port [ 934.964227] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d8966b3-0df4-4687-b824-af52ed7c3d17 with Priority: HIGHEST for action port [ 934.964571] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d8966b3-0df4-4687-b824-af52ed7c3d17 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.964710] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d8966b3-0df4-4687-b824-af52ed7c3d17" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.964773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d8966b3-0df4-4687-b824-af52ed7c3d17" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.966616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d8966b3-0df4-4687-b824-af52ed7c3d17" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.970055] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d8966b3-0df4-4687-b824-af52ed7c3d17',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.475551] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d8966b3-0df4-4687-b824-af52ed7c3d17 [ 935.475551] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.475551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.475551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.475551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.475950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.475950] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d8966b3-0df4-4687-b824-af52ed7c3d17 already deleted. [ 935.476024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d8966b3-0df4-4687-b824-af52ed7c3d17" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.818386] env[68109]: INFO networking_nsxv3.common.synchronization [req-ec5ba092-ba69-4862-8300-f811c79ddd37 req-7472aee3-4c90-4e7b-93d6-a1a355a251b7 tempest-InstanceActionsTestJSON-1065134437 tempest-InstanceActionsTestJSON-1065134437-project-member] Enqueued Resource ID: 4ea34252-af52-4a69-b365-67afcde4765d with Priority: HIGHEST for action security_group_members [ 935.819021] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea34252-af52-4a69-b365-67afcde4765d with Priority: HIGHEST for action security_group_members [ 935.819400] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea34252-af52-4a69-b365-67afcde4765d taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.819684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.819684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.819930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.820171] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.820311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.820406] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.820607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.821234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.821234] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ea34252-af52-4a69-b365-67afcde4765d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.930081] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 935.930081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.241980] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.242300] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-755" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.242568] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-755" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.242970] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-755" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.243606] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.243706] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.243870] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.244180] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.244404] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.244775] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.245122] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 936.245122] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 936.245298] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 936.245298] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.245384] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 936.245590] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 936.273910] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 936.274137] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 936.274290] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 936.274545] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-755" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.275172] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.275386] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.275516] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.276291] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.276470] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.325536] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.325728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.325796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.325991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.326106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.326306] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.326408] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.326466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.326622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.326699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.326780] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ea34252-af52-4a69-b365-67afcde4765d already deleted. [ 936.326871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.780769] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.781103] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.781293] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.781616] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.781690] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.781968] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb not found, creating... [ 936.782167] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.782336] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.782822] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.782822] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.782916] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.783293] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.783486] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.783612] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.783848] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.783991] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.784170] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb is going to be created. [ 936.805950] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.806281] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.806367] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.806681] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.806950] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.807206] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.158686] env[68109]: INFO networking_nsxv3.common.synchronization [None req-0247eeef-a346-4166-aba0-3ffb80908123 None None] Enqueued Resource ID: bfa12386-64ce-4353-9341-83afdd9c9df6 with Priority: HIGHEST for action port [ 937.159445] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfa12386-64ce-4353-9341-83afdd9c9df6 with Priority: HIGHEST for action port [ 937.159876] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfa12386-64ce-4353-9341-83afdd9c9df6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.160192] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfa12386-64ce-4353-9341-83afdd9c9df6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.160313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfa12386-64ce-4353-9341-83afdd9c9df6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.160663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfa12386-64ce-4353-9341-83afdd9c9df6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.160811] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfa12386-64ce-4353-9341-83afdd9c9df6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.500408] env[68109]: INFO networking_nsxv3.common.synchronization [req-ec5ba092-ba69-4862-8300-f811c79ddd37 req-78500cab-646f-4b93-b7f5-f54e76a02cf4 service nova] Enqueued Resource ID: 4ea34252-af52-4a69-b365-67afcde4765d with Priority: HIGHEST for action security_group_rules [ 937.500675] env[68109]: INFO networking_nsxv3.common.synchronization [req-ec5ba092-ba69-4862-8300-f811c79ddd37 req-78500cab-646f-4b93-b7f5-f54e76a02cf4 service nova] Enqueued Resource ID: 4ea34252-af52-4a69-b365-67afcde4765d with Priority: HIGHEST for action security_group_members [ 937.501651] env[68109]: INFO networking_nsxv3.common.synchronization [req-ec5ba092-ba69-4862-8300-f811c79ddd37 req-78500cab-646f-4b93-b7f5-f54e76a02cf4 service nova] Enqueued Resource ID: fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb with Priority: HIGHEST for action port [ 937.503322] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea34252-af52-4a69-b365-67afcde4765d with Priority: HIGHEST for action security_group_rules [ 937.503604] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea34252-af52-4a69-b365-67afcde4765d with Priority: HIGHEST for action security_group_members [ 937.504787] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb with Priority: HIGHEST for action port [ 937.505151] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ea34252-af52-4a69-b365-67afcde4765d taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.505336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.505446] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.505742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.507308] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ea34252-af52-4a69-b365-67afcde4765d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.508828] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea34252-af52-4a69-b365-67afcde4765d taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.508828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.508828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.508828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.510334] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.512022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.512022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.512022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.512022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.512022] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ea34252-af52-4a69-b365-67afcde4765d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.512897] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.513038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.513111] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.513301] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.513493] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.664351] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bfa12386-64ce-4353-9341-83afdd9c9df6 [ 937.664673] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.664825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.664896] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.665165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.665259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.665358] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bfa12386-64ce-4353-9341-83afdd9c9df6 already deleted. [ 937.665440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfa12386-64ce-4353-9341-83afdd9c9df6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.014875] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ea34252-af52-4a69-b365-67afcde4765d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.016183] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea34252-af52-4a69-b365-67afcde4765d taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.016183] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.019413] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb with status ACTIVE [ 938.019413] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.019413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.019413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.019581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.019581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.019856] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.019856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.019964] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.020063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.020138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.020394] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.020462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.020497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.020658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.020724] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.020774] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb is going to be updated. [ 938.042665] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.042665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.042665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.042665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.042665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.042665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd1fd080-2c8a-4aac-92e1-a6d5f94d8cfb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.401952] env[68109]: INFO networking_nsxv3.common.synchronization [req-14e27c27-6c26-477d-a783-a5c83627430b req-029b650b-c779-4d14-a1cf-88022fff7005 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 with Priority: HIGHEST for action security_group_members [ 938.401952] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 with Priority: HIGHEST for action security_group_members [ 938.402189] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-15c24162-8d2d-427e-9b29-f175f91a92c1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.403432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.403432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.403432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.403432] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.403432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.403432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.403432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.403432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.403432] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15c24162-8d2d-427e-9b29-f175f91a92c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.517445] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ea34252-af52-4a69-b365-67afcde4765d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.855263] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.857478] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.858371] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.858371] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.858666] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.858966] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.859232] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.859617] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.859898] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.860260] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.860435] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.860709] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.860978] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.861224] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.861400] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.861675] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.880684] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.880808] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 938.880979] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.881106] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.881390] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-124c8c01-6073-4ebf-8c67-2d89aaf8e17d taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.881575] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-124c8c01-6073-4ebf-8c67-2d89aaf8e17d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.881703] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-124c8c01-6073-4ebf-8c67-2d89aaf8e17d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.882112] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-124c8c01-6073-4ebf-8c67-2d89aaf8e17d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.882229] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('124c8c01-6073-4ebf-8c67-2d89aaf8e17d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.905364] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.905532] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.905566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.905852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.905950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.906169] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.906275] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.906337] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.906494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.906565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.906647] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 already deleted. [ 938.906724] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.020571] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.020770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.020866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.021026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.021115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.021220] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ea34252-af52-4a69-b365-67afcde4765d is going to be created. [ 939.044902] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.045108] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.045315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.045368] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.045497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.055569] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ea34252-af52-4a69-b365-67afcde4765d in Status: UNINITIALIZED for 2s [ 939.385363] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.385676] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.385840] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.386213] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.386395] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.386563] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 124c8c01-6073-4ebf-8c67-2d89aaf8e17d not found, creating... [ 939.386925] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.387149] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.387340] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.387616] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.387787] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.388226] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.388392] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.388586] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.388846] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.389061] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.389253] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 124c8c01-6073-4ebf-8c67-2d89aaf8e17d is going to be created. [ 939.409857] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.410149] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.410319] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.410685] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.410938] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.411239] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-124c8c01-6073-4ebf-8c67-2d89aaf8e17d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.438392] env[68109]: INFO networking_nsxv3.common.synchronization [req-14e27c27-6c26-477d-a783-a5c83627430b req-0d6bcbae-1a8a-4c9e-b248-5dd817ae001f service nova] Enqueued Resource ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 with Priority: HIGHEST for action security_group_rules [ 940.438736] env[68109]: INFO networking_nsxv3.common.synchronization [req-14e27c27-6c26-477d-a783-a5c83627430b req-0d6bcbae-1a8a-4c9e-b248-5dd817ae001f service nova] Enqueued Resource ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 with Priority: HIGHEST for action security_group_members [ 940.438736] env[68109]: INFO networking_nsxv3.common.synchronization [req-14e27c27-6c26-477d-a783-a5c83627430b req-0d6bcbae-1a8a-4c9e-b248-5dd817ae001f service nova] Enqueued Resource ID: 124c8c01-6073-4ebf-8c67-2d89aaf8e17d with Priority: HIGHEST for action port [ 940.438938] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 with Priority: HIGHEST for action security_group_rules [ 940.439083] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 with Priority: HIGHEST for action security_group_members [ 940.439183] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 124c8c01-6073-4ebf-8c67-2d89aaf8e17d with Priority: HIGHEST for action port [ 940.439737] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15c24162-8d2d-427e-9b29-f175f91a92c1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.439867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.439935] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.446025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.446025] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15c24162-8d2d-427e-9b29-f175f91a92c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.446025] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-15c24162-8d2d-427e-9b29-f175f91a92c1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.446025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.446025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.446025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.446025] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.446025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.446025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.446025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.446025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.446025] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15c24162-8d2d-427e-9b29-f175f91a92c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.447185] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-124c8c01-6073-4ebf-8c67-2d89aaf8e17d taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.447315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-124c8c01-6073-4ebf-8c67-2d89aaf8e17d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.447645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-124c8c01-6073-4ebf-8c67-2d89aaf8e17d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.447645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-124c8c01-6073-4ebf-8c67-2d89aaf8e17d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.447645] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('124c8c01-6073-4ebf-8c67-2d89aaf8e17d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.951436] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15c24162-8d2d-427e-9b29-f175f91a92c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.951436] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-15c24162-8d2d-427e-9b29-f175f91a92c1 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.951436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.951436] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 124c8c01-6073-4ebf-8c67-2d89aaf8e17d with status ACTIVE [ 940.951436] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.951436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.951436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.951998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.951998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.951998] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.951998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.951998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.953021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.953153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.953399] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.954027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.954027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.954027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.954027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.954371] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 124c8c01-6073-4ebf-8c67-2d89aaf8e17d is going to be updated. [ 940.974560] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.974695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.974763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.974975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.975134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.975454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-124c8c01-6073-4ebf-8c67-2d89aaf8e17d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.078281] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ea34252-af52-4a69-b365-67afcde4765d in Status: SUCCESS [ 941.078458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.078653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.078903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.079151] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.079303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.079348] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.079502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.079640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.079686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.079777] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ea34252-af52-4a69-b365-67afcde4765d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.455971] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15c24162-8d2d-427e-9b29-f175f91a92c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.584209] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea34252-af52-4a69-b365-67afcde4765d taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.584209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.584209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.584209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.584209] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.584639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.584639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.584895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.585522] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.585753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.586409] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea34252-af52-4a69-b365-67afcde4765d taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.586529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.586600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.586759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.586972] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.587155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.587237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.590510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.590510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.590510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.590510] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ea34252-af52-4a69-b365-67afcde4765d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.961032] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.961032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.961032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.961032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.961032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.961032] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 is going to be created. [ 941.987516] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.987516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.987516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.987760] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.987760] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.999177] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 in Status: UNINITIALIZED for 2s [ 942.092191] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ea34252-af52-4a69-b365-67afcde4765d: rpc.has_security_group_logging(os_id): False [ 942.108566] env[68109]: INFO networking_nsxv3.common.synchronization [req-f673c890-86b1-407b-bcd4-963d55fae978 req-ecb7d4a9-a824-4193-bd31-b01fd0b141cc tempest-DeleteServersTestJSON-2063667557 tempest-DeleteServersTestJSON-2063667557-project-member] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 942.109141] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 942.111403] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.111403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.111403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.111403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.111403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.111403] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.111403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.111403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.111777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.111858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.112084] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.112180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.112241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.112386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.112502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.112642] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.112738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.112790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.112927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.113082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.113127] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ea34252-af52-4a69-b365-67afcde4765d is going to be created. [ 942.115123] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.115123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.115123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.115123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.115341] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.115341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.115341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.115432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.115555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.115640] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.173241] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.173476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.173476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.173709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.173879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.186461] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ea34252-af52-4a69-b365-67afcde4765d in Status: IN_PROGRESS for 2s [ 942.620633] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.621013] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.621013] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.621213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.621286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.621503] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.621640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.621709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.621856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.621927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.622017] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 942.651868] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.652200] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.652200] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.652428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.652572] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.663396] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 944.007928] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 in Status: SUCCESS [ 944.008203] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.008363] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.008546] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.008740] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.008854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.008921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.009092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.009171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.009256] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.009352] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15c24162-8d2d-427e-9b29-f175f91a92c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.102168] env[68109]: INFO networking_nsxv3.common.synchronization [None req-b4672458-a3bf-4e2d-abba-e9e64892905b None None] Enqueued Resource ID: eba9c00e-2aa6-4fa1-8655-a6a49f94a23a with Priority: HIGHEST for action port [ 944.102586] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba9c00e-2aa6-4fa1-8655-a6a49f94a23a with Priority: HIGHEST for action port [ 944.102915] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-eba9c00e-2aa6-4fa1-8655-a6a49f94a23a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.106148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eba9c00e-2aa6-4fa1-8655-a6a49f94a23a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.106296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eba9c00e-2aa6-4fa1-8655-a6a49f94a23a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.106566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eba9c00e-2aa6-4fa1-8655-a6a49f94a23a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.106689] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eba9c00e-2aa6-4fa1-8655-a6a49f94a23a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.198841] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ea34252-af52-4a69-b365-67afcde4765d in Status: SUCCESS [ 944.202064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.511813] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15c24162-8d2d-427e-9b29-f175f91a92c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.610246] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eba9c00e-2aa6-4fa1-8655-a6a49f94a23a [ 944.610246] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.610246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.610555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.610689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.610763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.610929] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eba9c00e-2aa6-4fa1-8655-a6a49f94a23a already deleted. [ 944.611084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eba9c00e-2aa6-4fa1-8655-a6a49f94a23a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.675556] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 944.675848] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 deletion is rescheduled due to dependency. [ 944.675848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.016327] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15c24162-8d2d-427e-9b29-f175f91a92c1: rpc.has_security_group_logging(os_id): False [ 945.036172] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.036172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.036172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.040067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.040118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.040417] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.040540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.040606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.040793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.040873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.041047] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 is going to be created. [ 945.106295] env[68109]: INFO networking_nsxv3.common.synchronization [req-b10e2098-d69a-4fc1-a51d-db250f25e4fd req-d9295f1f-d15d-45f5-acdf-2abd3303c38c tempest-ListImageFiltersTestJSON-1245384511 tempest-ListImageFiltersTestJSON-1245384511-project-member] Enqueued Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_members [ 945.107468] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.107582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.107743] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.108732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.108732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.110692] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_members [ 945.111035] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.111152] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.111218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.111395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.111537] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.111679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.111679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.111840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.112137] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.112137] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.123043] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 in Status: IN_PROGRESS for 2s [ 945.615777] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.945675] env[68109]: INFO networking_nsxv3.common.synchronization [req-d961ec30-e6b4-44d9-9760-ebaa21576e26 req-ff316ba5-2df0-476c-a2c9-6238cc8c9719 tempest-ServersTestBootFromVolume-1173265696 tempest-ServersTestBootFromVolume-1173265696-project-member] Enqueued Resource ID: 817904c7-035a-41ce-bf21-c0db158c7bea with Priority: HIGHEST for action security_group_members [ 945.946288] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 817904c7-035a-41ce-bf21-c0db158c7bea with Priority: HIGHEST for action security_group_members [ 945.946603] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-817904c7-035a-41ce-bf21-c0db158c7bea taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.946735] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.946828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.947050] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.947231] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.947326] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.947403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.947556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.947655] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.947749] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('817904c7-035a-41ce-bf21-c0db158c7bea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.118143] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.444093] env[68109]: INFO networking_nsxv3.common.synchronization [req-bd3c44a8-f89e-4afe-8d10-36a894a2e399 req-6a790ccc-dbcb-43de-91d9-e9dba84652c2 tempest-ServerDiskConfigTestJSON-1064584538 tempest-ServerDiskConfigTestJSON-1064584538-project-member] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 946.444715] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 946.445181] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.445347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.445437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.446423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.446423] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.446423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.446423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.446423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.446423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.446423] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.451367] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.451780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.451847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.452295] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.475980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.476444] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.476634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.476746] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.477810] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.477810] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.477948] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 817904c7-035a-41ce-bf21-c0db158c7bea is going to be updated. [ 946.502062] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.502197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.502243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.502448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.502608] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.509789] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 817904c7-035a-41ce-bf21-c0db158c7bea in Status: IN_PROGRESS for 2s [ 946.624794] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.624794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.624794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.624794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.624794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.624794] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e812d957-e1ec-4f99-86c2-485e7c16988a is going to be updated. [ 946.659336] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.659336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.659336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.659336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.659336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.666674] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e812d957-e1ec-4f99-86c2-485e7c16988a in Status: IN_PROGRESS for 2s [ 946.910491] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-332 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.910717] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.910836] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.911079] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.911348] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.911567] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.911700] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.911924] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.912089] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.912315] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.912427] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.912598] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.912696] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.912795] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.912912] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.913095] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.936074] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.936256] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 946.936406] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.936590] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.936910] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-d0a0d474-c5ef-4710-8268-b466b0d2ee4e taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.937098] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-d0a0d474-c5ef-4710-8268-b466b0d2ee4e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.937876] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-d0a0d474-c5ef-4710-8268-b466b0d2ee4e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.938136] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-d0a0d474-c5ef-4710-8268-b466b0d2ee4e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.938282] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0a0d474-c5ef-4710-8268-b466b0d2ee4e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.948575] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.948723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.948813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.948985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.949187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.951070] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.951070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.951070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.951070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.951070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.951070] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 946.975706] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.975866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.975904] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.976189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.976342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.987867] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 947.136246] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 in Status: SUCCESS [ 947.136611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.284969] env[68109]: INFO networking_nsxv3.common.synchronization [None req-f0308ba3-8cbc-4ac6-b01f-5d4f057ebd0e None None] Enqueued Resource ID: edc98be2-e8f2-4194-b516-0f0aae0a47c1 with Priority: HIGHEST for action port [ 947.285613] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc98be2-e8f2-4194-b516-0f0aae0a47c1 with Priority: HIGHEST for action port [ 947.285943] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-edc98be2-e8f2-4194-b516-0f0aae0a47c1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.286086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edc98be2-e8f2-4194-b516-0f0aae0a47c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.286155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edc98be2-e8f2-4194-b516-0f0aae0a47c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.286426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edc98be2-e8f2-4194-b516-0f0aae0a47c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.286509] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edc98be2-e8f2-4194-b516-0f0aae0a47c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.440432] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.440675] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.440812] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.441220] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.441272] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.441426] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port d0a0d474-c5ef-4710-8268-b466b0d2ee4e not found, creating... [ 947.441696] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.442623] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.442623] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.442623] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.442623] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.442806] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.442869] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.442945] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.443183] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.443324] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.443838] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: d0a0d474-c5ef-4710-8268-b466b0d2ee4e is going to be created. [ 947.463266] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.463405] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.463534] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.463841] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.464446] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.464446] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-d0a0d474-c5ef-4710-8268-b466b0d2ee4e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.789764] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port edc98be2-e8f2-4194-b516-0f0aae0a47c1 [ 947.789764] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.789764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.789962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.790044] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.790148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.790246] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:edc98be2-e8f2-4194-b516-0f0aae0a47c1 already deleted. [ 947.790337] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edc98be2-e8f2-4194-b516-0f0aae0a47c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.317273] env[68109]: INFO networking_nsxv3.common.synchronization [req-bd3c44a8-f89e-4afe-8d10-36a894a2e399 req-8ffc825c-64a8-4bc6-a0a4-a08ef910f7fd service nova] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_rules [ 948.317558] env[68109]: INFO networking_nsxv3.common.synchronization [req-bd3c44a8-f89e-4afe-8d10-36a894a2e399 req-8ffc825c-64a8-4bc6-a0a4-a08ef910f7fd service nova] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 948.317558] env[68109]: INFO networking_nsxv3.common.synchronization [req-bd3c44a8-f89e-4afe-8d10-36a894a2e399 req-8ffc825c-64a8-4bc6-a0a4-a08ef910f7fd service nova] Enqueued Resource ID: d0a0d474-c5ef-4710-8268-b466b0d2ee4e with Priority: HIGHEST for action port [ 948.317999] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_rules [ 948.318396] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 948.318498] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0a0d474-c5ef-4710-8268-b466b0d2ee4e with Priority: HIGHEST for action port [ 948.318777] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.318903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.318970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.319545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.319545] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.323182] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.323182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.323182] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0a0d474-c5ef-4710-8268-b466b0d2ee4e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.323182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0a0d474-c5ef-4710-8268-b466b0d2ee4e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.323182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0a0d474-c5ef-4710-8268-b466b0d2ee4e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.323182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0a0d474-c5ef-4710-8268-b466b0d2ee4e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.323182] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0a0d474-c5ef-4710-8268-b466b0d2ee4e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.520881] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 817904c7-035a-41ce-bf21-c0db158c7bea in Status: SUCCESS [ 948.521089] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 817904c7-035a-41ce-bf21-c0db158c7bea deletion is rescheduled due to dependency. [ 948.521205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.679215] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e812d957-e1ec-4f99-86c2-485e7c16988a in Status: SUCCESS [ 948.679215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.824835] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0a0d474-c5ef-4710-8268-b466b0d2ee4e with status ACTIVE [ 948.825093] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.825234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.825305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.825517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.825608] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.825781] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.825886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.825949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.826107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.826170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.826348] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.826442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.826501] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.826647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.826717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.826958] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0a0d474-c5ef-4710-8268-b466b0d2ee4e is going to be updated. [ 948.828109] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.828220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.846471] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.846607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.846666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.846856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.846992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.847175] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0a0d474-c5ef-4710-8268-b466b0d2ee4e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.997555] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 948.997727] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 deletion is rescheduled due to dependency. [ 948.997851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.998513] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.998766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.999083] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.999083] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.999261] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.999308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.999360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.999456] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.465021] env[68109]: INFO networking_nsxv3.common.synchronization [None req-0d8d4ffd-4fd5-4201-a154-c733b58462c4 None None] Enqueued Resource ID: 367cd155-0d7c-474d-acde-a1eae5c6f922 with Priority: HIGHEST for action port [ 949.465590] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367cd155-0d7c-474d-acde-a1eae5c6f922 with Priority: HIGHEST for action port [ 949.466253] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-367cd155-0d7c-474d-acde-a1eae5c6f922 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.466253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-367cd155-0d7c-474d-acde-a1eae5c6f922" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.466253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-367cd155-0d7c-474d-acde-a1eae5c6f922" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.468180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-367cd155-0d7c-474d-acde-a1eae5c6f922" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.468180] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('367cd155-0d7c-474d-acde-a1eae5c6f922',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.503203] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.971521] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 367cd155-0d7c-474d-acde-a1eae5c6f922 [ 949.971521] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.971521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.971768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.971768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.971862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.971982] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:367cd155-0d7c-474d-acde-a1eae5c6f922 already deleted. [ 949.972044] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-367cd155-0d7c-474d-acde-a1eae5c6f922" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.005166] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.509924] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.509924] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.509924] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.510482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.510482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.510482] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 950.538099] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.538270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.538344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.538564] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.538693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.547285] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 950.611398] env[68109]: INFO networking_nsxv3.common.synchronization [None req-ff3bef3e-1a5b-4532-ad44-ccad78182cc1 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_rules [ 950.612580] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_rules [ 950.612580] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.612704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.612798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.613102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.613262] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.709624] env[68109]: INFO networking_nsxv3.common.synchronization [None req-665020ff-ca11-4743-b4c2-e8ca440f7337 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_rules [ 950.709624] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_rules [ 950.709624] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.709624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.135454] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.135634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.135675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.135874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.135965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.136075] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 already deleted. [ 951.136160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.136315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.136474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.136558] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.506549] env[68109]: INFO networking_nsxv3.common.synchronization [None req-53b0ef78-98fc-4ad9-9f2b-0e6204c0d9e7 None None] Enqueued Resource ID: 94eeb337-0034-40e4-b20d-92631d96d694 with Priority: HIGHEST for action port [ 951.506856] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94eeb337-0034-40e4-b20d-92631d96d694 with Priority: HIGHEST for action port [ 951.507552] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-94eeb337-0034-40e4-b20d-92631d96d694 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.507660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94eeb337-0034-40e4-b20d-92631d96d694" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.507730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94eeb337-0034-40e4-b20d-92631d96d694" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.508059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94eeb337-0034-40e4-b20d-92631d96d694" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.508149] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94eeb337-0034-40e4-b20d-92631d96d694',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.658266] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.658591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.658591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.658727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.658814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.659210] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 already deleted. [ 951.659210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.011265] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94eeb337-0034-40e4-b20d-92631d96d694 [ 952.011265] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.011265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.011265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.011265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.011265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.011265] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94eeb337-0034-40e4-b20d-92631d96d694 already deleted. [ 952.011265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94eeb337-0034-40e4-b20d-92631d96d694" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.559066] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 952.559309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.560029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.560029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.560257] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.560382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.560448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.560617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.560698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.560785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.560880] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.063477] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.063808] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.063808] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.063968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.064151] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.064311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.064311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.064454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.064537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.064662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.064792] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.064886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.064942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.065096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.065231] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.065338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.065399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.065504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.065579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.065704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.065812] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.567558] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7eff74c-b690-47ef-ba84-9ec9d2765c99: rpc.has_security_group_logging(os_id): False [ 953.581335] env[68109]: INFO networking_nsxv3.common.synchronization [req-9ed71c77-e4d1-48c8-9720-a10e6d01a3d4 req-a51d8f14-d966-403c-982d-bcf58e08adad tempest-InstanceActionsTestJSON-1065134437 tempest-InstanceActionsTestJSON-1065134437-project-member] Enqueued Resource ID: 4ea34252-af52-4a69-b365-67afcde4765d with Priority: HIGHEST for action security_group_members [ 953.581869] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea34252-af52-4a69-b365-67afcde4765d with Priority: HIGHEST for action security_group_members [ 953.582230] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea34252-af52-4a69-b365-67afcde4765d taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.582350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.582411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.582812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.583105] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.583231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.583310] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.583481] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.583568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.583663] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ea34252-af52-4a69-b365-67afcde4765d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.585449] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.585449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.585449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.585598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.585627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.586809] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.586809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.586809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.586809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.586809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.586809] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.586809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.586809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.586809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.586809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.587269] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.587269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.587269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.587269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.587269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.587408] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 953.650419] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.650566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.650604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.650813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.650959] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.665867] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 954.089512] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.089816] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.089816] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.089950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.090113] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.090317] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.090439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.090505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.090802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.090921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.091083] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ea34252-af52-4a69-b365-67afcde4765d is going to be updated. [ 954.119862] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.120014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.120097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.120330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.120434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.128024] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ea34252-af52-4a69-b365-67afcde4765d in Status: IN_PROGRESS for 2s [ 955.686647] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 955.687018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.139149] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ea34252-af52-4a69-b365-67afcde4765d in Status: SUCCESS [ 956.139627] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ea34252-af52-4a69-b365-67afcde4765d deletion is rescheduled due to dependency. [ 956.139916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.007032] env[68109]: INFO networking_nsxv3.common.synchronization [req-e3eb9560-b9ac-4eff-877e-3a15ace459cc req-30ed879e-6ec5-4aab-a416-a9e7d4355057 tempest-ServersV294TestFqdnHostnames-578105793 tempest-ServersV294TestFqdnHostnames-578105793-project-member] Enqueued Resource ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 with Priority: HIGHEST for action security_group_members [ 957.007032] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 with Priority: HIGHEST for action security_group_members [ 957.007032] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f244466-a6a8-4118-96a9-bf22e5d33c96 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.007032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.007032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.007706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.007706] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.007706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.007706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.007845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.007845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.007898] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f244466-a6a8-4118-96a9-bf22e5d33c96',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.514158] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.514314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.514407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.514602] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.514761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.514960] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.515087] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.515156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.515330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.516027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.516027] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 is going to be updated. [ 957.543060] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.543231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.543318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.543568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.543736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.561179] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 in Status: IN_PROGRESS for 2s [ 959.571969] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 in Status: SUCCESS [ 959.572269] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f244466-a6a8-4118-96a9-bf22e5d33c96 deletion is rescheduled due to dependency. [ 959.572269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f244466-a6a8-4118-96a9-bf22e5d33c96" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.967044] env[68109]: INFO networking_nsxv3.common.synchronization [req-f43755f7-3487-4885-9851-386a6d878a59 req-e6ff8c76-c43f-407c-b0d5-d651f82917cd tempest-MigrationsAdminTest-481783089 tempest-MigrationsAdminTest-481783089-project-member] Enqueued Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_members [ 959.967521] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_members [ 959.967919] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.967919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.968146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.968407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.968671] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.968671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.968867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.968867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.968995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.969071] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.040879] env[68109]: INFO networking_nsxv3.common.synchronization [req-ef5f4bd6-f079-49b5-8765-ea17c6f1cdfe req-f7733768-20ea-40a9-9e96-ae0cdde42649 tempest-ServersNegativeTestJSON-2006371617 tempest-ServersNegativeTestJSON-2006371617-project-member] Enqueued Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_members [ 960.041423] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_members [ 960.041666] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.041786] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.041852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.042109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.042271] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.042365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.042414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.042611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.042671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.042746] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.369497] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-973 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.369758] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-973" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.369820] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-973" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.370177] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-973" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.370626] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.370873] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.371036] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.371273] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.371423] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.371636] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.371786] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.371911] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.372038] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.372157] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 960.372267] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.372406] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.389969] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.390159] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 960.390300] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.390470] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-973" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.391176] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-79d1c435-b96b-4aff-bd9e-b0be86082816 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.391176] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.391176] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.391469] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.391555] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79d1c435-b96b-4aff-bd9e-b0be86082816',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.471142] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.547740] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.547874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.547874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.548121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.548214] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.548411] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.548765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.548765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.548765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.548765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.548939] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b already deleted. [ 960.548939] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.893897] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.894358] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.894358] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.894610] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.894809] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.894995] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 79d1c435-b96b-4aff-bd9e-b0be86082816 not found, creating... [ 960.895299] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.895483] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.895611] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.895854] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.896036] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.896316] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.896474] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.896599] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.896813] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.896954] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.897115] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 79d1c435-b96b-4aff-bd9e-b0be86082816 is going to be created. [ 960.927583] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.927788] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.927895] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.928333] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.928582] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.928810] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.974472] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.478998] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.478998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.478998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.478998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.478998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.478998] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a is going to be updated. [ 961.504305] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.504643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.504846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.506597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.506597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.513167] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a in Status: IN_PROGRESS for 2s [ 961.969035] env[68109]: INFO networking_nsxv3.common.synchronization [req-0487e809-bbeb-4bb0-b1cf-fc8b76a4c37b req-c394c205-7bb5-4154-8820-7decc3c10a47 tempest-ServerActionsTestOtherB-1748290489 tempest-ServerActionsTestOtherB-1748290489-project-member] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 961.969035] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 961.973438] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.973568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.973634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.973864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.973996] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.974121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.974191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.974313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.974394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.974486] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.000022] env[68109]: INFO networking_nsxv3.common.synchronization [req-ef5f4bd6-f079-49b5-8765-ea17c6f1cdfe req-f1b5d295-2064-4186-81e7-458d12d54905 service nova] Enqueued Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_rules [ 962.000243] env[68109]: INFO networking_nsxv3.common.synchronization [req-ef5f4bd6-f079-49b5-8765-ea17c6f1cdfe req-f1b5d295-2064-4186-81e7-458d12d54905 service nova] Enqueued Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_members [ 962.000392] env[68109]: INFO networking_nsxv3.common.synchronization [req-ef5f4bd6-f079-49b5-8765-ea17c6f1cdfe req-f1b5d295-2064-4186-81e7-458d12d54905 service nova] Enqueued Resource ID: 79d1c435-b96b-4aff-bd9e-b0be86082816 with Priority: HIGHEST for action port [ 962.000843] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_rules [ 962.000978] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_members [ 962.001096] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79d1c435-b96b-4aff-bd9e-b0be86082816 with Priority: HIGHEST for action port [ 962.001565] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.001702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.001744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.001986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.002087] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.002921] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.003053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.003120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.003287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.003428] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.003559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.003594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.003700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.003780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.003868] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.004873] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-79d1c435-b96b-4aff-bd9e-b0be86082816 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.004967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.005120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.005283] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.005360] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79d1c435-b96b-4aff-bd9e-b0be86082816',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.479115] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.479115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.479115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.479115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.500828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.501106] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.501224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.501292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.501489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.501571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.501663] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be updated. [ 962.507042] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.507897] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.507986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.508688] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79d1c435-b96b-4aff-bd9e-b0be86082816 with status ACTIVE [ 962.508688] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.508688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.508688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.508688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.508688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.508941] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.508941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.508941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.509091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.509387] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.509387] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.509508] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.509508] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.509636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.509680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.509745] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79d1c435-b96b-4aff-bd9e-b0be86082816 is going to be updated. [ 962.538157] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.538335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.538447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.538621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.538758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.538898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.539828] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.539942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.539983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.540159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.540285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.572233] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: IN_PROGRESS for 2s [ 963.013156] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.516054] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.516253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.516253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.516463] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.516547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.516642] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b is going to be created. [ 963.526153] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a in Status: SUCCESS [ 963.526348] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.548274] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.548479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.548479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.548679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.548836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.557575] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: UNINITIALIZED for 2s [ 964.521722] env[68109]: INFO networking_nsxv3.common.synchronization [req-8493633b-40e3-4f19-a62f-39f552b6770c req-23142029-db3e-4d52-86b2-dda34bb0dd1f tempest-AttachVolumeShelveTestJSON-1309092891 tempest-AttachVolumeShelveTestJSON-1309092891-project-member] Enqueued Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_members [ 964.522261] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGHEST for action security_group_members [ 964.522559] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-50bf3a02-de03-46e5-a1de-389d8f706b9b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.522686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.522749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.522957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.523149] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.523291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.523367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.524097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.524187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.524257] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.581008] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 964.581202] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 deletion is rescheduled due to dependency. [ 964.581315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.026656] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.026821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.026896] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.027145] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.027238] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.027436] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.027535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.027596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.027745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.027839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.027933] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b is going to be updated. [ 965.055121] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.055382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.055475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.055740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.055898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.065103] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b in Status: IN_PROGRESS for 2s [ 965.566784] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: SUCCESS [ 965.567050] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.567185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.567405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.567593] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.567711] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.567776] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.567925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.568013] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.568116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.568208] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.070717] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.071045] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.071213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.071594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.071860] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.072045] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.072169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.072450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.072631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.072828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.073418] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.073418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.073418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.073584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.074179] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.074179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.074179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.074425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.074425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.074546] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.074629] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.577428] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bcda49a-0e74-4618-bd35-62ff5440bd3b: rpc.has_security_group_logging(os_id): False [ 966.593970] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.594151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.594197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.594409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.594497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.594688] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.594823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.594913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.595093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.595173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.595373] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.595468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.595530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.595669] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.595745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.595931] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.596040] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.596248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.596248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.596335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.596398] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b is going to be created. [ 966.650779] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.650966] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.651056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.651257] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.651436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.661162] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: IN_PROGRESS for 2s [ 967.074358] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b in Status: SUCCESS [ 967.074577] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b deletion is rescheduled due to dependency. [ 967.074653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.113884] env[68109]: INFO networking_nsxv3.common.synchronization [req-ebc23854-c632-4f78-81bc-ad51bb49de77 req-cc08a54a-804f-4735-88c8-bf9c4ad10072 tempest-ImagesTestJSON-447768907 tempest-ImagesTestJSON-447768907-project-member] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 967.114419] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 967.114816] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.114997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.115156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.115414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.115711] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.116329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.116329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.116329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.116329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.116329] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.445906] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.447017] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.447017] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.447017] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.447377] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.447701] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.447993] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.448399] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.448658] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.449079] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.450851] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.450851] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.450851] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.450851] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 967.450851] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.450851] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.471337] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.471337] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 967.471337] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.471337] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.471337] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-4d93ea63-2e4d-4a3b-85c7-2e0768a5b537 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.471601] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-4d93ea63-2e4d-4a3b-85c7-2e0768a5b537" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.471601] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-4d93ea63-2e4d-4a3b-85c7-2e0768a5b537" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.471855] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-4d93ea63-2e4d-4a3b-85c7-2e0768a5b537" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.472141] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d93ea63-2e4d-4a3b-85c7-2e0768a5b537',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.621354] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.975052] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.975052] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.975052] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.975350] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.975529] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.975692] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 4d93ea63-2e4d-4a3b-85c7-2e0768a5b537 not found, creating... [ 967.975984] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.976169] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.976291] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.976530] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.976759] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.977221] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.977491] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.977700] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.978060] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.978300] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.978533] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 4d93ea63-2e4d-4a3b-85c7-2e0768a5b537 is going to be created. [ 967.996498] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.996708] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.996838] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.997121] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.997369] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.997619] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-4d93ea63-2e4d-4a3b-85c7-2e0768a5b537" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.124119] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.626861] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.627210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.627210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.627287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.627336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.627419] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be updated. [ 968.653337] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.654443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.654443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.654443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.654443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.661550] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 968.671820] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: SUCCESS [ 968.672066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.696915] env[68109]: INFO networking_nsxv3.common.synchronization [req-ebc23854-c632-4f78-81bc-ad51bb49de77 req-264add16-772d-4a20-8c2b-cb8307ecb9ca service nova] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_rules [ 968.697151] env[68109]: INFO networking_nsxv3.common.synchronization [req-ebc23854-c632-4f78-81bc-ad51bb49de77 req-264add16-772d-4a20-8c2b-cb8307ecb9ca service nova] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 968.697297] env[68109]: INFO networking_nsxv3.common.synchronization [req-ebc23854-c632-4f78-81bc-ad51bb49de77 req-264add16-772d-4a20-8c2b-cb8307ecb9ca service nova] Enqueued Resource ID: 4d93ea63-2e4d-4a3b-85c7-2e0768a5b537 with Priority: HIGHEST for action port [ 968.697522] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_rules [ 968.697650] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 968.697792] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d93ea63-2e4d-4a3b-85c7-2e0768a5b537 with Priority: HIGHEST for action port [ 968.698289] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.700172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.700255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.700490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.700580] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.701505] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.701607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.701808] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d93ea63-2e4d-4a3b-85c7-2e0768a5b537 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.702263] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d93ea63-2e4d-4a3b-85c7-2e0768a5b537" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.702263] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d93ea63-2e4d-4a3b-85c7-2e0768a5b537" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.702263] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d93ea63-2e4d-4a3b-85c7-2e0768a5b537" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.702263] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d93ea63-2e4d-4a3b-85c7-2e0768a5b537',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.205242] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.206107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.206306] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d93ea63-2e4d-4a3b-85c7-2e0768a5b537 with status ACTIVE [ 969.206436] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.206637] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.206756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.207072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.207261] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.207536] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.207691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.207861] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.208060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.208247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.208963] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.208963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.208963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.208963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.209191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.209191] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d93ea63-2e4d-4a3b-85c7-2e0768a5b537 is going to be updated. [ 969.229274] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.229378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.229480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.229675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.229861] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.230078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d93ea63-2e4d-4a3b-85c7-2e0768a5b537" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.671684] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 970.671684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.672051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.672213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.672317] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.672492] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.672602] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.672777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.672861] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.672965] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.177063] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.680311] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.761428] env[68109]: INFO networking_nsxv3.common.synchronization [req-294001ec-5249-4c35-a50a-648f2e474022 req-4762980b-366f-4d3a-9bfb-3140f856823f tempest-ListImageFiltersTestJSON-1245384511 tempest-ListImageFiltersTestJSON-1245384511-project-member] Enqueued Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_members [ 971.761715] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGHEST for action security_group_members [ 971.762123] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.762461] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.762461] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.762603] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.762802] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.762933] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.763133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.763367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.763497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.763602] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.183273] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.183465] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.183563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.183812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.184158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.184158] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be updated. [ 972.212797] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.213533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.213533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.214781] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.214781] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.224071] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 972.265637] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.265836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.265912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.266151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.266248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.266442] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.266540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.266605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.266759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.266854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.266993] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e812d957-e1ec-4f99-86c2-485e7c16988a is going to be updated. [ 972.304076] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.304076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.304076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.304076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.304076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.311597] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e812d957-e1ec-4f99-86c2-485e7c16988a in Status: IN_PROGRESS for 2s [ 973.345042] env[68109]: INFO networking_nsxv3.common.synchronization [req-9ff417d3-0241-4d4b-8a7f-4baf31347d57 req-68a2fc7c-02ee-4537-b560-0413e4ddb7e9 tempest-ServerPasswordTestJSON-574249698 tempest-ServerPasswordTestJSON-574249698-project-member] Enqueued Resource ID: 128e84ba-79f2-427a-b1a9-229985255d74 with Priority: HIGHEST for action security_group_members [ 973.345925] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 128e84ba-79f2-427a-b1a9-229985255d74 with Priority: HIGHEST for action security_group_members [ 973.346308] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-128e84ba-79f2-427a-b1a9-229985255d74 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.346468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.346553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.346827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.347014] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.347193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.347279] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.347505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.347821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.347953] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('128e84ba-79f2-427a-b1a9-229985255d74',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.668462] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-915 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.668675] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-915" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.668796] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-915" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.669169] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-915" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.669439] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.669606] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.669730] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.669951] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.670299] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.670527] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.670646] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.670761] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.670874] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.670988] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.671110] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.671248] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.690367] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.690532] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 973.690643] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.690840] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-915" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.691179] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-41985fdb-1d50-4633-b602-9729ac7e100c taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.691355] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-41985fdb-1d50-4633-b602-9729ac7e100c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.691483] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-41985fdb-1d50-4633-b602-9729ac7e100c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.692359] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-41985fdb-1d50-4633-b602-9729ac7e100c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.692501] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41985fdb-1d50-4633-b602-9729ac7e100c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.850571] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.850734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.850852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.851116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.851214] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.851428] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.851531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.851585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.851745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.851825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.851909] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 128e84ba-79f2-427a-b1a9-229985255d74 already deleted. [ 973.851986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.195360] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.195543] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.195673] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.196049] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.196142] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.196308] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 41985fdb-1d50-4633-b602-9729ac7e100c not found, creating... [ 974.196570] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.196727] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.196849] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.197082] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.197222] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.197505] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.197659] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.197778] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.198024] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.198138] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.198281] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 41985fdb-1d50-4633-b602-9729ac7e100c is going to be created. [ 974.218343] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.218643] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.218831] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.219039] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.219305] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.219554] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-41985fdb-1d50-4633-b602-9729ac7e100c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.237712] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 974.238010] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.238140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.238363] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.238561] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.238670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.238751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.238981] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.239086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.239173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.239267] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.321562] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e812d957-e1ec-4f99-86c2-485e7c16988a in Status: SUCCESS [ 974.321750] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e812d957-e1ec-4f99-86c2-485e7c16988a deletion is rescheduled due to dependency. [ 974.321879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.741015] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.741366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.741366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.741481] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.741652] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.741754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.741817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.741965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.742063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.742157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.742302] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.742432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.742494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.742592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.742731] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.742822] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.742884] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.743043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.743107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.743188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.743279] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.925441] env[68109]: INFO networking_nsxv3.common.synchronization [req-9ff417d3-0241-4d4b-8a7f-4baf31347d57 req-021f3182-e2ff-4e5b-ba38-32ce68410c9f service nova] Enqueued Resource ID: 128e84ba-79f2-427a-b1a9-229985255d74 with Priority: HIGHEST for action security_group_rules [ 974.925622] env[68109]: INFO networking_nsxv3.common.synchronization [req-9ff417d3-0241-4d4b-8a7f-4baf31347d57 req-021f3182-e2ff-4e5b-ba38-32ce68410c9f service nova] Enqueued Resource ID: 128e84ba-79f2-427a-b1a9-229985255d74 with Priority: HIGHEST for action security_group_members [ 974.925822] env[68109]: INFO networking_nsxv3.common.synchronization [req-9ff417d3-0241-4d4b-8a7f-4baf31347d57 req-021f3182-e2ff-4e5b-ba38-32ce68410c9f service nova] Enqueued Resource ID: 41985fdb-1d50-4633-b602-9729ac7e100c with Priority: HIGHEST for action port [ 974.926077] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 128e84ba-79f2-427a-b1a9-229985255d74 with Priority: HIGHEST for action security_group_rules [ 974.926200] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 128e84ba-79f2-427a-b1a9-229985255d74 with Priority: HIGHEST for action security_group_members [ 974.926293] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41985fdb-1d50-4633-b602-9729ac7e100c with Priority: HIGHEST for action port [ 974.926904] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-128e84ba-79f2-427a-b1a9-229985255d74 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.929274] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.929390] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.929674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.929759] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('128e84ba-79f2-427a-b1a9-229985255d74',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.930729] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-128e84ba-79f2-427a-b1a9-229985255d74 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.931174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.931174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.931174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.931598] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.931711] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.931786] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.931929] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.932023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.932146] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('128e84ba-79f2-427a-b1a9-229985255d74',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.933050] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-41985fdb-1d50-4633-b602-9729ac7e100c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.933215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41985fdb-1d50-4633-b602-9729ac7e100c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.933291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41985fdb-1d50-4633-b602-9729ac7e100c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.933731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41985fdb-1d50-4633-b602-9729ac7e100c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.933731] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41985fdb-1d50-4633-b602-9729ac7e100c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.246926] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bd26aad-19e8-435d-b39a-5875f3b5cfd7: rpc.has_security_group_logging(os_id): False [ 975.266210] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.266431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.266431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.266626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.266705] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.266952] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.267064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.267113] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.267275] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.267357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.267536] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.267650] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.267731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.267875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.267941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.268238] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.268337] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.268397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.268557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.268635] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.268722] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be updated. [ 975.328492] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.329422] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.329422] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.329422] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.329422] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.339913] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 975.437851] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('128e84ba-79f2-427a-b1a9-229985255d74',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.437851] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-128e84ba-79f2-427a-b1a9-229985255d74 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.437851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.437851] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41985fdb-1d50-4633-b602-9729ac7e100c with status ACTIVE [ 975.437851] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.437851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.437851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.437851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.437851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.437851] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.438848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.439211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.439496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.439758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.440171] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.440404] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.440565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.440873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.441064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.441231] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41985fdb-1d50-4633-b602-9729ac7e100c is going to be updated. [ 975.484178] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.484178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.484178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.484178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.484178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.484178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41985fdb-1d50-4633-b602-9729ac7e100c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.937684] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('128e84ba-79f2-427a-b1a9-229985255d74',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.439787] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.439956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.440048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.440250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.440341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.440536] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 128e84ba-79f2-427a-b1a9-229985255d74 is going to be created. [ 976.461922] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.461922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.461922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.462133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.462133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.470525] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 128e84ba-79f2-427a-b1a9-229985255d74 in Status: UNINITIALIZED for 2s [ 977.353681] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 977.354063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.480355] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 128e84ba-79f2-427a-b1a9-229985255d74 in Status: SUCCESS [ 978.480588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.480588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.480813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.480991] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.481116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.481192] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.481349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.481439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.481754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.481754] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('128e84ba-79f2-427a-b1a9-229985255d74',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.983661] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-128e84ba-79f2-427a-b1a9-229985255d74 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.985460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.985548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.985770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.985962] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.986096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.986161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.986333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.986494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.986534] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.986661] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-128e84ba-79f2-427a-b1a9-229985255d74 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.986753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.986814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.986965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.987097] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.987180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.987242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.987371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.987454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.987521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.987611] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('128e84ba-79f2-427a-b1a9-229985255d74',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.032741] env[68109]: INFO networking_nsxv3.common.synchronization [req-b3d4a0ac-cd6d-47bc-8ab1-c600586a6ce3 req-e2bdce3c-e099-44ec-9ebb-0ec47f724207 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_members [ 979.033346] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_members [ 979.033661] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.033816] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.033816] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.034026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.034682] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.035874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.035874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.035874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.035874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.035874] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.378190] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.378506] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.378774] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.378986] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.379347] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.379514] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.379636] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.380590] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.380755] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.380984] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.381117] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.381233] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.381345] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.381459] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.381572] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.381709] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.400159] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.400319] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 979.400707] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.400707] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.400903] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-40fbd73d-67b8-4ebb-acfc-9d9a652ab927 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.401168] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-40fbd73d-67b8-4ebb-acfc-9d9a652ab927" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.401258] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-40fbd73d-67b8-4ebb-acfc-9d9a652ab927" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.401504] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-40fbd73d-67b8-4ebb-acfc-9d9a652ab927" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.401647] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40fbd73d-67b8-4ebb-acfc-9d9a652ab927',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.490159] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 128e84ba-79f2-427a-b1a9-229985255d74: rpc.has_security_group_logging(os_id): False [ 979.507206] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.507360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.507421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.507631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.507720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.508021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.508107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.508107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.508251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.508330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.508507] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.508599] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.508657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.508793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.508869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.510554] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.510679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.510765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.510904] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.510986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.511171] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 128e84ba-79f2-427a-b1a9-229985255d74 is going to be created. [ 979.537329] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.539783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.539783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.539783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.539783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.539783] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.539783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.539783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.539783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.539783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.539783] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 already deleted. [ 979.539783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.565836] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.565994] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.566080] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.566289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.566468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.579973] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 128e84ba-79f2-427a-b1a9-229985255d74 in Status: IN_PROGRESS for 2s [ 979.903644] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.903908] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.904090] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.904427] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.904599] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.904773] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 40fbd73d-67b8-4ebb-acfc-9d9a652ab927 not found, creating... [ 979.905112] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.905306] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.905434] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.905693] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.905852] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.906855] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.907050] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.907199] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.907417] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.907592] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.907767] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 40fbd73d-67b8-4ebb-acfc-9d9a652ab927 is going to be created. [ 979.927545] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.927796] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.927942] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.928449] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.928725] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.928974] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-40fbd73d-67b8-4ebb-acfc-9d9a652ab927" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.942201] env[68109]: INFO networking_nsxv3.common.synchronization [None req-e04abe5b-ff72-43e5-8309-bb28cad8c35c None None] Enqueued Resource ID: 5fae5c2b-61b5-4ebe-adec-2f731a052f85 with Priority: HIGHEST for action port [ 979.942503] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fae5c2b-61b5-4ebe-adec-2f731a052f85 with Priority: HIGHEST for action port [ 979.943083] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fae5c2b-61b5-4ebe-adec-2f731a052f85 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.943236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fae5c2b-61b5-4ebe-adec-2f731a052f85" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.943300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fae5c2b-61b5-4ebe-adec-2f731a052f85" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.943553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fae5c2b-61b5-4ebe-adec-2f731a052f85" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.943647] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fae5c2b-61b5-4ebe-adec-2f731a052f85',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.445661] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fae5c2b-61b5-4ebe-adec-2f731a052f85 [ 980.446308] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.446620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.446787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.447093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.447276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.447619] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fae5c2b-61b5-4ebe-adec-2f731a052f85 already deleted. [ 980.447619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fae5c2b-61b5-4ebe-adec-2f731a052f85" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.274430] env[68109]: INFO networking_nsxv3.common.synchronization [req-b3d4a0ac-cd6d-47bc-8ab1-c600586a6ce3 req-c8b1eb02-c154-459b-89c6-b31a09e0921a service nova] Enqueued Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_rules [ 981.274685] env[68109]: INFO networking_nsxv3.common.synchronization [req-b3d4a0ac-cd6d-47bc-8ab1-c600586a6ce3 req-c8b1eb02-c154-459b-89c6-b31a09e0921a service nova] Enqueued Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_members [ 981.274762] env[68109]: INFO networking_nsxv3.common.synchronization [req-b3d4a0ac-cd6d-47bc-8ab1-c600586a6ce3 req-c8b1eb02-c154-459b-89c6-b31a09e0921a service nova] Enqueued Resource ID: 40fbd73d-67b8-4ebb-acfc-9d9a652ab927 with Priority: HIGHEST for action port [ 981.276512] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_rules [ 981.276649] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_members [ 981.276749] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40fbd73d-67b8-4ebb-acfc-9d9a652ab927 with Priority: HIGHEST for action port [ 981.279339] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.279458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.279523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.279751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.279795] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.281211] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.281211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.281211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.281351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.282540] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.282540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.282540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.282540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.282540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.282540] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.284238] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-40fbd73d-67b8-4ebb-acfc-9d9a652ab927 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.284238] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40fbd73d-67b8-4ebb-acfc-9d9a652ab927" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.284238] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40fbd73d-67b8-4ebb-acfc-9d9a652ab927" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.284722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40fbd73d-67b8-4ebb-acfc-9d9a652ab927" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.285576] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40fbd73d-67b8-4ebb-acfc-9d9a652ab927',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.591343] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 128e84ba-79f2-427a-b1a9-229985255d74 in Status: SUCCESS [ 981.591343] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.793172] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.793172] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.793172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.793172] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40fbd73d-67b8-4ebb-acfc-9d9a652ab927 with status ACTIVE [ 981.793172] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.793172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.793172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.793172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.793172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.793172] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.793172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.793172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.793172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.793172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.793695] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.793695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.793695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.793695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.793695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.793695] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40fbd73d-67b8-4ebb-acfc-9d9a652ab927 is going to be updated. [ 981.819192] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.819327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.819327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.819817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.819817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.819817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40fbd73d-67b8-4ebb-acfc-9d9a652ab927" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.295258] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.800578] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.800740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.800814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.801045] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.801137] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.801376] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 is going to be created. [ 982.825639] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.825877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.825996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.826312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.826564] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.836110] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: UNINITIALIZED for 2s [ 982.980352] env[68109]: INFO networking_nsxv3.common.synchronization [None req-eae9585a-2cd6-4b43-b8fa-6b023c4ec992 None None] Enqueued Resource ID: 57e92eae-d734-4403-9149-a440d0c55cdc with Priority: HIGHEST for action port [ 982.980979] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57e92eae-d734-4403-9149-a440d0c55cdc with Priority: HIGHEST for action port [ 982.981814] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-57e92eae-d734-4403-9149-a440d0c55cdc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.982008] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57e92eae-d734-4403-9149-a440d0c55cdc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.982413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57e92eae-d734-4403-9149-a440d0c55cdc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.982703] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57e92eae-d734-4403-9149-a440d0c55cdc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.982853] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57e92eae-d734-4403-9149-a440d0c55cdc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.485775] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57e92eae-d734-4403-9149-a440d0c55cdc [ 983.485775] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.485775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.485775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.486894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.486894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.486894] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57e92eae-d734-4403-9149-a440d0c55cdc already deleted. [ 983.486894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57e92eae-d734-4403-9149-a440d0c55cdc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.850295] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: SUCCESS [ 984.850568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.853913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.853913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.853913] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.853913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.853913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.853913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.853913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.853913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.853913] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.357014] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.363270] env[68109]: INFO networking_nsxv3.common.synchronization [req-576fbc2f-01b0-46d1-8a94-5c06e8788464 req-41ffbadd-b48f-47ee-aeb8-96f40bfaccfd tempest-ImagesTestJSON-447768907 tempest-ImagesTestJSON-447768907-project-member] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 985.363876] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 985.364566] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.364753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.364917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.365187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.365317] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.365317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.365557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.365557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.365750] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.365808] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.859927] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c79bef7-bf07-4509-8ec1-1db749783b03: rpc.has_security_group_logging(os_id): False [ 985.868051] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.877181] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.877532] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.877532] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.877628] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.877692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.877924] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.878045] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.878110] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.878262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.878337] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.878422] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 is going to be created. [ 985.954875] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.955065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.955139] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.955362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.955866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.968320] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: IN_PROGRESS for 2s [ 986.370639] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.874343] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.874664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.874664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.874921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.875063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.876308] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be updated. [ 986.900898] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.901130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.901231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.901465] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.901642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.909181] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 987.625796] env[68109]: INFO networking_nsxv3.common.synchronization [req-ef33db8a-fffe-4d56-bb04-9e7bcec05c08 req-4c50406b-0799-4f4c-a619-0a7332428a45 tempest-ServerPasswordTestJSON-574249698 tempest-ServerPasswordTestJSON-574249698-project-member] Enqueued Resource ID: 128e84ba-79f2-427a-b1a9-229985255d74 with Priority: HIGHEST for action security_group_members [ 987.626933] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 128e84ba-79f2-427a-b1a9-229985255d74 with Priority: HIGHEST for action security_group_members [ 987.626933] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-128e84ba-79f2-427a-b1a9-229985255d74 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.626933] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.626933] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.627249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.627249] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.627249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.627357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.627444] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.627525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.627620] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('128e84ba-79f2-427a-b1a9-229985255d74',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.979267] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: SUCCESS [ 987.979540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.130072] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.130250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.130326] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.130545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.130636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.131129] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.131129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.131129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.131315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.131315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.131315] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 128e84ba-79f2-427a-b1a9-229985255d74 is going to be updated. [ 988.156993] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.157166] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.157241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.157719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.157894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.167421] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 128e84ba-79f2-427a-b1a9-229985255d74 in Status: IN_PROGRESS for 2s [ 988.919187] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 988.919423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.179564] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 128e84ba-79f2-427a-b1a9-229985255d74 in Status: SUCCESS [ 990.179564] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 128e84ba-79f2-427a-b1a9-229985255d74 deletion is rescheduled due to dependency. [ 990.179564] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.786186] env[68109]: INFO networking_nsxv3.common.synchronization [None req-05160c94-6fcf-42ad-a97a-b700a1cad673 tempest-AttachVolumeShelveTestJSON-1309092891 tempest-AttachVolumeShelveTestJSON-1309092891-project-member] Enqueued Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_rules [ 991.786691] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_rules [ 991.787010] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.787145] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.787210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.787460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.787540] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.858664] env[68109]: INFO networking_nsxv3.common.synchronization [None req-6072f33e-8972-4bf9-b431-1f73043c19f9 tempest-AttachVolumeShelveTestJSON-1309092891 tempest-AttachVolumeShelveTestJSON-1309092891-project-member] Enqueued Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_rules [ 991.859155] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_rules [ 991.859485] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.859762] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.282210] env[68109]: INFO networking_nsxv3.common.synchronization [req-2f81d126-8e63-406d-931b-499313f77f19 req-f5cafe99-8824-443b-912f-0f2205b4c83a tempest-MigrationsAdminTest-481783089 tempest-MigrationsAdminTest-481783089-project-member] Enqueued Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_members [ 992.282740] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGHEST for action security_group_members [ 992.283067] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.283197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.283266] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.283461] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.283622] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.283710] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.283772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.284019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.284019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.284651] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.308288] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.308288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.308288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.308288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.308288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.308288] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 already deleted. [ 992.308288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.308634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.308634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.308634] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.555126] env[68109]: INFO networking_nsxv3.common.synchronization [req-92f7d90f-909c-4964-b9a4-98f269906014 req-6cd42e43-100c-418f-a53f-334affd44392 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 992.555796] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 992.559379] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.559551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.559637] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.559891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.560102] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.560245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.560575] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.560575] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.560725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.560773] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.786631] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.786934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.786934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.787127] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.787230] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.787438] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.787534] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.787596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.787758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.787841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.787925] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a is going to be updated. [ 992.811764] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.811904] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.811978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.812184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.812333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.821449] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a in Status: IN_PROGRESS for 2s [ 992.831186] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.831186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.831358] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.831446] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.831522] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.831621] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 already deleted. [ 992.831704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.067406] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.067406] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.067688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.067688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.067746] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.067928] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.068038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.068103] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.068248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.068334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.068410] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 993.093973] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.094132] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.094203] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.094393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.094532] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.102182] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 993.111227] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.111622] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.111761] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.112030] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.112283] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.112480] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.112552] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.112764] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.112937] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.113189] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.113310] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.113424] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.113536] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.113651] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.113760] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.113895] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.133214] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.133214] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 993.133214] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.133387] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.133559] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-7218efa1-6929-4c10-8cb7-534e85549475 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.133733] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-7218efa1-6929-4c10-8cb7-534e85549475" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.133854] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-7218efa1-6929-4c10-8cb7-534e85549475" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.134205] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-7218efa1-6929-4c10-8cb7-534e85549475" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.134343] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7218efa1-6929-4c10-8cb7-534e85549475',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.305706] env[68109]: INFO networking_nsxv3.common.synchronization [req-dec201d8-00a3-4f4e-8faf-e375c71f5501 req-f69c0882-b878-4e5c-b928-2509540ad03b tempest-DeleteServersTestJSON-2063667557 tempest-DeleteServersTestJSON-2063667557-project-member] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 993.306321] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 993.306886] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.306886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.306886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.307136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.307361] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.307468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.307532] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.307709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.307791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.307886] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.603289] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-505 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.603478] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.603600] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.605518] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.605787] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.605946] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.606099] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.606376] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.606529] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.606749] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.606868] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.606980] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.607106] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.607233] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.607356] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.607493] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.625272] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.625425] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 993.625566] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.625728] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.626034] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-d879921f-c9e1-4839-b3b1-b85ed6e0905c taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.626745] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-d879921f-c9e1-4839-b3b1-b85ed6e0905c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.626745] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-d879921f-c9e1-4839-b3b1-b85ed6e0905c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.626745] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-d879921f-c9e1-4839-b3b1-b85ed6e0905c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.626902] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d879921f-c9e1-4839-b3b1-b85ed6e0905c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.636746] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.636946] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.637089] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.637348] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.637607] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.637684] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 7218efa1-6929-4c10-8cb7-534e85549475 not found, creating... [ 993.637911] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.638050] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.638175] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.638405] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.638752] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.638820] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.638981] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.639137] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.639351] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.639613] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.639761] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 7218efa1-6929-4c10-8cb7-534e85549475 is going to be created. [ 993.660755] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.660755] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.660755] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.660755] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.660755] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.660755] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-7218efa1-6929-4c10-8cb7-534e85549475" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.811421] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.811728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.811728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.811857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.811961] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.812170] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.812359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.812359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.812498] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.812534] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.812617] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 993.840959] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.841156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.841227] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.841439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.841662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.850052] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 994.129494] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.129716] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.129847] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.130162] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.130317] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.130478] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port d879921f-c9e1-4839-b3b1-b85ed6e0905c not found, creating... [ 994.130751] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.130911] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.131052] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.131282] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.131422] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.131702] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.131860] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.131981] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.132202] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.132341] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.132483] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: d879921f-c9e1-4839-b3b1-b85ed6e0905c is going to be created. [ 994.156945] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.157165] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.157311] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.157565] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.157787] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.158006] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-d879921f-c9e1-4839-b3b1-b85ed6e0905c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.356013] env[68109]: INFO networking_nsxv3.common.synchronization [req-92f7d90f-909c-4964-b9a4-98f269906014 req-af886d55-b262-4323-be72-468496ff82d7 service nova] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_rules [ 994.356309] env[68109]: INFO networking_nsxv3.common.synchronization [req-92f7d90f-909c-4964-b9a4-98f269906014 req-af886d55-b262-4323-be72-468496ff82d7 service nova] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 994.356482] env[68109]: INFO networking_nsxv3.common.synchronization [req-92f7d90f-909c-4964-b9a4-98f269906014 req-af886d55-b262-4323-be72-468496ff82d7 service nova] Enqueued Resource ID: 7218efa1-6929-4c10-8cb7-534e85549475 with Priority: HIGHEST for action port [ 994.357091] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_rules [ 994.357735] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 994.357877] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7218efa1-6929-4c10-8cb7-534e85549475 with Priority: HIGHEST for action port [ 994.358174] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.358307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.358377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.358590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.358675] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.359570] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.359623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.359776] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-7218efa1-6929-4c10-8cb7-534e85549475 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.359870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7218efa1-6929-4c10-8cb7-534e85549475" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.359930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7218efa1-6929-4c10-8cb7-534e85549475" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.360111] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7218efa1-6929-4c10-8cb7-534e85549475" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.360189] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7218efa1-6929-4c10-8cb7-534e85549475',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.831500] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a in Status: SUCCESS [ 994.831785] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a deletion is rescheduled due to dependency. [ 994.831785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.835596] env[68109]: INFO networking_nsxv3.common.synchronization [req-dec201d8-00a3-4f4e-8faf-e375c71f5501 req-33e5b94b-ece8-4ef7-af06-2e226dc5f33d service nova] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_rules [ 994.835596] env[68109]: INFO networking_nsxv3.common.synchronization [req-dec201d8-00a3-4f4e-8faf-e375c71f5501 req-33e5b94b-ece8-4ef7-af06-2e226dc5f33d service nova] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 994.835596] env[68109]: INFO networking_nsxv3.common.synchronization [req-dec201d8-00a3-4f4e-8faf-e375c71f5501 req-33e5b94b-ece8-4ef7-af06-2e226dc5f33d service nova] Enqueued Resource ID: d879921f-c9e1-4839-b3b1-b85ed6e0905c with Priority: HIGHEST for action port [ 994.835596] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_rules [ 994.835596] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 994.835596] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d879921f-c9e1-4839-b3b1-b85ed6e0905c with Priority: HIGHEST for action port [ 994.835596] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.835596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.835998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.835998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.835998] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.836778] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.836873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.837741] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-d879921f-c9e1-4839-b3b1-b85ed6e0905c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.837741] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d879921f-c9e1-4839-b3b1-b85ed6e0905c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.837741] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d879921f-c9e1-4839-b3b1-b85ed6e0905c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.837741] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d879921f-c9e1-4839-b3b1-b85ed6e0905c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.837741] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d879921f-c9e1-4839-b3b1-b85ed6e0905c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.862473] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.862473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.862758] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7218efa1-6929-4c10-8cb7-534e85549475 with status ACTIVE [ 994.862758] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.862880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.862880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.863138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.863306] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.864071] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.864071] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.864071] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.864071] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.864071] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.864071] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.864071] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.864071] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.864394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.864394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.864394] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7218efa1-6929-4c10-8cb7-534e85549475 is going to be updated. [ 994.883642] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.883818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.883881] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.884087] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.884239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.884406] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7218efa1-6929-4c10-8cb7-534e85549475" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.112688] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 995.112902] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf deletion is rescheduled due to dependency. [ 995.113064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.113232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.113443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.113620] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.113735] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.113801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.113951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.114273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.114273] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.339447] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.339632] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.339817] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d879921f-c9e1-4839-b3b1-b85ed6e0905c with status ACTIVE [ 995.339993] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.340118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.340176] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.340378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.340468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.340655] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.340740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.340788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.340973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.341053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.341186] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.341278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.341337] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.341471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.341544] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.341639] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d879921f-c9e1-4839-b3b1-b85ed6e0905c is going to be updated. [ 995.362572] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.362713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.362787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.363058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.363206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.363412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d879921f-c9e1-4839-b3b1-b85ed6e0905c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.616413] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.705994] env[68109]: INFO networking_nsxv3.common.synchronization [req-00b77269-cb5e-4195-bba3-37f8045830d9 req-0e3bd1a3-a7ff-4d69-988d-d33cb55826d0 tempest-ServersNegativeTestJSON-2006371617 tempest-ServersNegativeTestJSON-2006371617-project-member] Enqueued Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_members [ 995.706514] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_members [ 995.707051] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.707193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.707271] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.707451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.707597] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.707693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.707751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.707895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.709102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.709216] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.864186] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 995.864186] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 deletion is rescheduled due to dependency. [ 995.864186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.864186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.864186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.864186] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.864186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.864186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.864186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.864186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.864773] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.118872] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.132324] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-973 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.132538] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-973" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.132702] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-973" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.133048] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-973" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.133350] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.133517] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.133650] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.133885] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.134048] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.134274] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 996.134915] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.135099] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.135224] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.135352] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 996.135466] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.135605] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.155095] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.155272] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 996.155376] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.155551] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-973" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.156129] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-252bcec0-eb8b-4bdb-9eb3-2fc943462e55 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.156129] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-252bcec0-eb8b-4bdb-9eb3-2fc943462e55" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.156306] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-252bcec0-eb8b-4bdb-9eb3-2fc943462e55" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.156952] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-252bcec0-eb8b-4bdb-9eb3-2fc943462e55" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.156952] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('252bcec0-eb8b-4bdb-9eb3-2fc943462e55',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.211097] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.366254] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.622057] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.622221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.622221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.622395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.622484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.622583] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 996.653643] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.653813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.653869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.654075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.654222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.658657] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.658847] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.658976] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.659262] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.659377] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.659528] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 252bcec0-eb8b-4bdb-9eb3-2fc943462e55 not found, creating... [ 996.659774] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.659931] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.660064] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.660282] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.660467] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.660852] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.661091] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.661236] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.661453] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.661615] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.661810] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 252bcec0-eb8b-4bdb-9eb3-2fc943462e55 is going to be created. [ 996.663411] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 996.681300] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.681682] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.681790] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.682114] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.682372] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.682601] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-252bcec0-eb8b-4bdb-9eb3-2fc943462e55" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.713431] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.868890] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.215470] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.215677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.215761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.216222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.216222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.216222] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b is going to be updated. [ 997.246485] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.247650] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.248307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.248550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.248738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.257989] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: IN_PROGRESS for 2s [ 997.371941] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.372213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.372213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.372414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.372503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.372605] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 997.405161] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.405161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.405161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.405161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.405493] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.416090] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 997.472305] env[68109]: INFO networking_nsxv3.common.synchronization [req-00b77269-cb5e-4195-bba3-37f8045830d9 req-751031b9-0397-4410-acca-c40dc3459f24 service nova] Enqueued Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_rules [ 997.472481] env[68109]: INFO networking_nsxv3.common.synchronization [req-00b77269-cb5e-4195-bba3-37f8045830d9 req-751031b9-0397-4410-acca-c40dc3459f24 service nova] Enqueued Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_members [ 997.472685] env[68109]: INFO networking_nsxv3.common.synchronization [req-00b77269-cb5e-4195-bba3-37f8045830d9 req-751031b9-0397-4410-acca-c40dc3459f24 service nova] Enqueued Resource ID: 252bcec0-eb8b-4bdb-9eb3-2fc943462e55 with Priority: HIGHEST for action port [ 997.472900] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_rules [ 997.473034] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_members [ 997.473124] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 252bcec0-eb8b-4bdb-9eb3-2fc943462e55 with Priority: HIGHEST for action port [ 997.474766] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.474898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.474977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.475807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.475807] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.476131] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.476227] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.476412] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-252bcec0-eb8b-4bdb-9eb3-2fc943462e55 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.476504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-252bcec0-eb8b-4bdb-9eb3-2fc943462e55" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.476566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-252bcec0-eb8b-4bdb-9eb3-2fc943462e55" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.476733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-252bcec0-eb8b-4bdb-9eb3-2fc943462e55" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.476804] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('252bcec0-eb8b-4bdb-9eb3-2fc943462e55',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.978461] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.978891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.978891] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 252bcec0-eb8b-4bdb-9eb3-2fc943462e55 with status ACTIVE [ 997.978891] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.979129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.979129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.979335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.979335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.979500] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.979570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.979626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.979892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.979971] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.980160] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.980305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.980305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.980440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.980506] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.980604] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 252bcec0-eb8b-4bdb-9eb3-2fc943462e55 is going to be updated. [ 998.000664] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.000664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.000865] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.000941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.001376] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.001376] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-252bcec0-eb8b-4bdb-9eb3-2fc943462e55" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.673843] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 998.674074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.674638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.674638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.674638] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.674910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.674910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.675054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.675054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.675171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.675227] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.732599] env[68109]: INFO networking_nsxv3.common.synchronization [req-469cdcb2-8c5c-4f00-b406-d60925d5881a req-efc9ee7d-1c2b-4794-aade-55071c9ef91a tempest-ServersWithSpecificFlavorTestJSON-306442882 tempest-ServersWithSpecificFlavorTestJSON-306442882-project-member] Enqueued Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_members [ 998.733235] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f with Priority: HIGHEST for action security_group_members [ 998.733587] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.733747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.733784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.733982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.734394] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.734549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.734656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.736111] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.736111] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.736111] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1b52ab9-23fb-4785-af13-8d3e64d2b62f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.177463] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.177737] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.177737] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.177897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.178074] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.178202] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.178238] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.178378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.178463] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.178553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.178696] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.178787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.178849] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.178993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.179205] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.179309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.179369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.179511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.179586] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.179670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.179765] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.237803] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.237977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.238049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.238248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.238346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.238547] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.238642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.238691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.238839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.238902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.238997] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f is going to be updated. [ 999.268955] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: SUCCESS [ 999.268955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.268955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.268955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.268955] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.268955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.268955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.268955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.268955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.268955] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.275120] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.275120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.275120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.275120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.275120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.281503] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f in Status: IN_PROGRESS for 2s [ 999.436802] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 999.437026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.437213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.437467] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.437686] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.437831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.437897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.438068] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.438152] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.438240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.438332] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.681968] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7573caa0-9f71-40fd-82c3-03fa2ce88dbf: rpc.has_security_group_logging(os_id): False [ 999.701350] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.701595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.701702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.702033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.702173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.702481] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.702632] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.702732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.702977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.703104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.703412] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.703608] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.703666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.703855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.703961] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.704292] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.706349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.706349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.706349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.706349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.706349] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 999.772602] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.778603] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.779265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.779265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.779265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.779265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.791261] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 999.940620] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.940788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.940859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.941415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.941621] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.942501] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.942575] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.942751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.942856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.943013] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.943170] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.943265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.943328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.943475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.943609] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.943716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.943776] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.943915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.943988] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.944087] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.944193] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.274467] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.447919] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3775fbff-3109-41e9-a7b4-71b12133d9f0: rpc.has_security_group_logging(os_id): False [ 1000.476522] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.476710] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.476782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.477020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.477189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.477420] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.477643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.477712] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.477894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.477967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.478337] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.478479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.478629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.478797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.479535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.479535] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.479535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.479535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.479730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.479781] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.479945] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 1000.518043] env[68109]: INFO networking_nsxv3.common.synchronization [None req-07627403-3a96-443b-9c23-91078a53e8b5 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1000.518949] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1000.519416] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.519562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.519632] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.519935] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.520143] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.520294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.520368] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.520550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.520637] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.520862] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.586399] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.586598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.586598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.586921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.587104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.610564] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 1000.779055] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.779055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.779055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.779055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.779055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.779381] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b is going to be updated. [ 1000.816296] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.816480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.816523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.816711] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.816856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.827710] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: IN_PROGRESS for 2s [ 1001.023872] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.290298] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f in Status: SUCCESS [ 1001.290566] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1b52ab9-23fb-4785-af13-8d3e64d2b62f deletion is rescheduled due to dependency. [ 1001.290602] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1b52ab9-23fb-4785-af13-8d3e64d2b62f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.464379] env[68109]: INFO networking_nsxv3.common.synchronization [req-c4d7c425-4896-4e82-bde6-612b84d930e1 req-ae2af3cd-1496-4b01-b448-723efb01b5f8 tempest-ServersTestMultiNic-1863331152 tempest-ServersTestMultiNic-1863331152-project-member] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1001.464883] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1001.465227] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.465353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.465416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.465670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.465822] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.465967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.466333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.466502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.466591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.466691] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.526828] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.789008] env[68109]: INFO networking_nsxv3.common.synchronization [req-c4d7c425-4896-4e82-bde6-612b84d930e1 req-ba2c0237-dc5d-4036-b33e-2bbea148b916 tempest-ServersTestMultiNic-1863331152 tempest-ServersTestMultiNic-1863331152-project-member] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1001.790234] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1001.790234] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.790393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.805058] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 1001.805322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.969291] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.969491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.969491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.969716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.969834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.970046] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.970150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.970217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.970367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.970447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.970541] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 already deleted. [ 1001.970637] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.970804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.970949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.971094] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.971191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.971259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.971430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.971515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.971582] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.029471] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.029627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.029698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.029911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.030012] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.030118] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 1002.039240] env[68109]: INFO networking_nsxv3.common.synchronization [req-c4d7c425-4896-4e82-bde6-612b84d930e1 req-6805ec49-73a3-41aa-ab47-49384466d6ad tempest-ServersTestMultiNic-1863331152 tempest-ServersTestMultiNic-1863331152-project-member] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1002.039488] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1002.040125] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.040125] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.059716] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.059848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.059919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.060133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.061652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.070688] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 1002.302131] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.302491] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-893" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.302534] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-893" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.304360] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-893" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.304671] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.304846] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.305010] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.308485] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.308485] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.308485] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.308485] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.308485] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.308485] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.308485] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.308485] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.308485] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.324434] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.324626] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1002.324728] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.324907] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-893" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.325351] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-b503bdf2-9f13-400f-bd42-dad0c7328df7 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.325558] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-b503bdf2-9f13-400f-bd42-dad0c7328df7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.325725] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-b503bdf2-9f13-400f-bd42-dad0c7328df7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.326098] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-b503bdf2-9f13-400f-bd42-dad0c7328df7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.326247] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b503bdf2-9f13-400f-bd42-dad0c7328df7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.474361] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.474562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.474601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.474886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.474886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.475212] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.475324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.475400] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.475547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.475625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.475709] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 already deleted. [ 1002.475910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.475993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.476184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.476331] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.476428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.476487] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.476623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.476700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.476791] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.629751] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 1002.629751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.641785] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.642013] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.642207] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.642615] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.643017] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.643196] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.643343] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.643618] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.643777] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.644172] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.644212] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.644327] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.644441] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.644595] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.644709] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.644848] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.668276] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.668470] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1002.668615] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.668796] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.669148] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-5a84e15f-ec78-4da3-baf1-973b4bf4f746 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.669336] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-5a84e15f-ec78-4da3-baf1-973b4bf4f746" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.669460] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-5a84e15f-ec78-4da3-baf1-973b4bf4f746" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.669824] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-5a84e15f-ec78-4da3-baf1-973b4bf4f746" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.669978] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a84e15f-ec78-4da3-baf1-973b4bf4f746',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.828637] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.828899] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.829047] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.829338] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.829495] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.829656] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port b503bdf2-9f13-400f-bd42-dad0c7328df7 not found, creating... [ 1002.829921] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.830096] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.830222] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.830450] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.830593] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.830880] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.831054] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.831215] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.831435] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.831575] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.831723] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: b503bdf2-9f13-400f-bd42-dad0c7328df7 is going to be created. [ 1002.840815] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: SUCCESS [ 1002.841008] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.841171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.841333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.841495] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.841590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.841654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.841793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.841869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.841953] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.842055] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.851249] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.851474] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.851602] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.851843] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.852085] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.852318] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-b503bdf2-9f13-400f-bd42-dad0c7328df7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.980064] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.980064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.980064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.980382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.980382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.980609] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.980759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.980871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.981103] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.981228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.981356] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 already deleted. [ 1002.981472] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.172217] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.172501] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.172648] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.172990] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.173138] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.173299] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 5a84e15f-ec78-4da3-baf1-973b4bf4f746 not found, creating... [ 1003.173578] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.173743] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.173892] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.174151] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.174300] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.174585] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.174830] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.174893] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.175195] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.175379] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.175565] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 5a84e15f-ec78-4da3-baf1-973b4bf4f746 is going to be created. [ 1003.194487] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.194704] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.194834] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.195186] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.195418] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.195650] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-5a84e15f-ec78-4da3-baf1-973b4bf4f746" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.344800] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.344800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.344800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.344800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.344800] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.344800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.345347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.345347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.345347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.345347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.345476] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.345476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.345540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.345747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.345831] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.345878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.345925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.346086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.346170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.346257] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.346386] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.553983] env[68109]: INFO networking_nsxv3.common.synchronization [req-c4d7c425-4896-4e82-bde6-612b84d930e1 req-075047ee-ffb7-4378-ba7e-369470819967 service nova] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_rules [ 1003.554137] env[68109]: INFO networking_nsxv3.common.synchronization [req-c4d7c425-4896-4e82-bde6-612b84d930e1 req-075047ee-ffb7-4378-ba7e-369470819967 service nova] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1003.554235] env[68109]: INFO networking_nsxv3.common.synchronization [req-c4d7c425-4896-4e82-bde6-612b84d930e1 req-075047ee-ffb7-4378-ba7e-369470819967 service nova] Enqueued Resource ID: b503bdf2-9f13-400f-bd42-dad0c7328df7 with Priority: HIGHEST for action port [ 1003.554461] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_rules [ 1003.554587] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1003.554681] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b503bdf2-9f13-400f-bd42-dad0c7328df7 with Priority: HIGHEST for action port [ 1003.556084] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.556819] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.556819] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.556819] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.557019] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.558100] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.558100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.558100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.558269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.558303] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.559391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.559391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.559391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.559391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.559391] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.559699] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-b503bdf2-9f13-400f-bd42-dad0c7328df7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.559699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b503bdf2-9f13-400f-bd42-dad0c7328df7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.559699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b503bdf2-9f13-400f-bd42-dad0c7328df7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.559824] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b503bdf2-9f13-400f-bd42-dad0c7328df7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.559824] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b503bdf2-9f13-400f-bd42-dad0c7328df7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.848834] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bcda49a-0e74-4618-bd35-62ff5440bd3b: rpc.has_security_group_logging(os_id): False [ 1003.866718] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.866900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.866954] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.867159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.867247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.867506] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.867582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.867582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.867755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.867839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.868072] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.868176] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.868241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.868381] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.868475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.868643] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.868740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.868802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.868944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.869030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.869115] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b is going to be updated. [ 1003.872750] env[68109]: INFO networking_nsxv3.common.synchronization [req-a39981a4-5e21-475a-b5ac-94eab13ed057 req-728a996b-37d2-4e25-96c7-e50de68b4508 service nova] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_rules [ 1003.873366] env[68109]: INFO networking_nsxv3.common.synchronization [req-a39981a4-5e21-475a-b5ac-94eab13ed057 req-728a996b-37d2-4e25-96c7-e50de68b4508 service nova] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1003.873366] env[68109]: INFO networking_nsxv3.common.synchronization [req-a39981a4-5e21-475a-b5ac-94eab13ed057 req-728a996b-37d2-4e25-96c7-e50de68b4508 service nova] Enqueued Resource ID: 5a84e15f-ec78-4da3-baf1-973b4bf4f746 with Priority: HIGHEST for action port [ 1003.873626] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_rules [ 1003.873774] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1003.873856] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a84e15f-ec78-4da3-baf1-973b4bf4f746 with Priority: HIGHEST for action port [ 1003.874108] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.874244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.874315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.874489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.874588] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.875511] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.875631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.875786] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a84e15f-ec78-4da3-baf1-973b4bf4f746 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.875897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a84e15f-ec78-4da3-baf1-973b4bf4f746" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.876332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a84e15f-ec78-4da3-baf1-973b4bf4f746" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.876332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a84e15f-ec78-4da3-baf1-973b4bf4f746" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.876332] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a84e15f-ec78-4da3-baf1-973b4bf4f746',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.930872] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.931098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.931098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.931291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.931428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.944152] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: IN_PROGRESS for 2s [ 1004.061824] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.061995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.065788] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b503bdf2-9f13-400f-bd42-dad0c7328df7 with status ACTIVE [ 1004.066013] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.066139] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.066222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.066433] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.066523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.066704] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.066813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.066904] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.067027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.067110] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.067296] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.067394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.067457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.067596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.067662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.067749] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b503bdf2-9f13-400f-bd42-dad0c7328df7 is going to be updated. [ 1004.068862] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.091023] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 1004.091256] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.091533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.091662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.091939] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.092108] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.092199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.092408] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.092500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.092601] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.107974] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.108123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.108214] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.108399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.108542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.108697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b503bdf2-9f13-400f-bd42-dad0c7328df7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.335820] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.335820] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-234" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.335820] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-234" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.336203] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-234" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.337112] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.337530] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.337784] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.338183] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.338423] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.338716] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.338899] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.339094] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.339290] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.339503] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.339683] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.339897] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.362618] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.362968] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1004.363668] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.363924] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-234" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.364462] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.364721] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.365139] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.365512] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.365822] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.378335] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.378585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.378916] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a84e15f-ec78-4da3-baf1-973b4bf4f746 with status ACTIVE [ 1004.379216] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.379412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.379542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.379860] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.380041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.380338] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.380495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.380619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.380905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.382444] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.382824] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.382824] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.382967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.383542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.383542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.383704] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a84e15f-ec78-4da3-baf1-973b4bf4f746 is going to be updated. [ 1004.407138] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.407567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.407703] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.407962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.408161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.408358] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a84e15f-ec78-4da3-baf1-973b4bf4f746" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.571975] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.595742] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.868657] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.868913] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.869074] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.869396] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.869750] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.869750] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9 not found, creating... [ 1004.870268] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.870268] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.870475] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.870595] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.870755] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.871072] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.871257] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.871392] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.872663] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.872663] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.872663] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9 is going to be created. [ 1004.896613] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.896820] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.896967] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.897282] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.897547] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.897809] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.076667] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.076667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.076667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.076667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.076667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.076667] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be created. [ 1005.098925] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.117925] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.119160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.119371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.119700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.120154] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.136064] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: UNINITIALIZED for 2s [ 1005.601123] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.601471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.601471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.601616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.601706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.601802] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 1005.641018] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.641168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.641241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.641493] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.641640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.653826] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 1005.823648] env[68109]: INFO networking_nsxv3.common.synchronization [req-bdbbd7df-933a-41e8-950b-390448f895c5 req-97eab883-d679-4a78-816c-588a0cba5f83 tempest-ImagesTestJSON-447768907 tempest-ImagesTestJSON-447768907-project-member] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 1005.824218] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 1005.824564] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.824690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.824690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.824855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.826446] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.826624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.826718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.827093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.827093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.827093] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.965863] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: SUCCESS [ 1005.966233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.331101] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.331291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.331384] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.331641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.331755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.331978] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.332135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.332239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.332465] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.332590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.332728] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be updated. [ 1006.366867] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.366867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.366867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.366867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.366867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.374664] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 1006.530580] env[68109]: INFO networking_nsxv3.common.synchronization [req-c4d7c425-4896-4e82-bde6-612b84d930e1 req-1e5f002f-7721-4152-bdb9-068b44bf2f71 service nova] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_rules [ 1006.530580] env[68109]: INFO networking_nsxv3.common.synchronization [req-c4d7c425-4896-4e82-bde6-612b84d930e1 req-1e5f002f-7721-4152-bdb9-068b44bf2f71 service nova] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1006.530580] env[68109]: INFO networking_nsxv3.common.synchronization [req-c4d7c425-4896-4e82-bde6-612b84d930e1 req-1e5f002f-7721-4152-bdb9-068b44bf2f71 service nova] Enqueued Resource ID: ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9 with Priority: HIGHEST for action port [ 1006.530580] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_rules [ 1006.530580] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1006.530580] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9 with Priority: HIGHEST for action port [ 1006.531440] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.531688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.532075] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.532257] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.532580] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.533079] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.533268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.533550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.534609] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.037035] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9 with status ACTIVE [ 1007.037376] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.037502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.037598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.037848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.037975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.038188] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.038290] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.038365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.038523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.038602] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.038986] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.038986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.038986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.039143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.039143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.039213] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9 is going to be updated. [ 1007.084648] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.084862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.084924] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.085197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.085362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.085534] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca4b8cf0-a7d5-4ac3-b5db-e8aaab9902c9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.093710] env[68109]: INFO networking_nsxv3.common.synchronization [req-de3039bf-00dd-47b9-b856-3378cf20d114 req-d4043d78-2665-4271-a8ef-029dac2536bb tempest-DeleteServersTestJSON-2063667557 tempest-DeleteServersTestJSON-2063667557-project-member] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 1007.095587] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 1007.096048] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.096946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.097120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.097627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.097936] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.098362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.098491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.098721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.098856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.099031] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.155431] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1007.155797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.156048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.156313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.156619] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.156743] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.156814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.157071] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.157215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.157363] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.157487] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.158438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.161928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.161928] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.161928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.161928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.161928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.161928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.161928] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.499970] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.499970] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-893" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.499970] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-893" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.499970] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-893" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.499970] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.499970] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.500497] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.501213] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.501666] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.502146] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.502243] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1007.502400] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1007.502587] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1007.502781] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.502913] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1007.503072] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1007.522604] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1007.522787] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1007.522963] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1007.523193] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-893" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.523529] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-6dd44bd6-e830-42f0-85f8-bb7a232ad879 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.523736] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-6dd44bd6-e830-42f0-85f8-bb7a232ad879" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.524400] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-6dd44bd6-e830-42f0-85f8-bb7a232ad879" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.524788] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-6dd44bd6-e830-42f0-85f8-bb7a232ad879" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.524955] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dd44bd6-e830-42f0-85f8-bb7a232ad879',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.601733] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.601898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.601975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.602192] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.602809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.603123] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.603237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.603298] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.603498] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.603582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.603631] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 1007.633364] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.633627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.633697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.633895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.634077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.642311] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 1007.661374] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.661706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.661706] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.663191] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 1007.663422] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.663650] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.663764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.667058] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.667058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.667058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.667058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.667058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.667058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.667058] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.735955] env[68109]: INFO networking_nsxv3.common.synchronization [req-e9600e4a-89ee-4dba-a872-1622683e1157 req-da08115f-eeaf-493a-ba33-4582b4755f02 tempest-ServerActionsTestOtherB-1748290489 tempest-ServerActionsTestOtherB-1748290489-project-member] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 1007.736508] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 1007.737011] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.737011] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.737011] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.737883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.737883] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.738221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.739026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.739341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.739731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.739863] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.028494] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.029411] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.033940] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.033940] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.033940] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.033940] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 6dd44bd6-e830-42f0-85f8-bb7a232ad879 not found, creating... [ 1008.034153] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.034741] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.034741] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.034741] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.034741] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.035122] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.035347] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.035503] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.035750] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.039019] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.039019] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 6dd44bd6-e830-42f0-85f8-bb7a232ad879 is going to be created. [ 1008.055678] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.055898] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.056009] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.056248] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.056984] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.056984] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-6dd44bd6-e830-42f0-85f8-bb7a232ad879" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.145818] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-535 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.146069] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.146241] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.146527] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.147087] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.147087] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.147087] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.147297] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.147556] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.147749] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.147868] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.147984] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.148111] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.148228] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.148343] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.148475] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.167773] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.168106] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1008.168331] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.168590] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.168981] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-8c350735-88b5-4b9d-a30b-43cc279f97d1 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.169361] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-8c350735-88b5-4b9d-a30b-43cc279f97d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.170068] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-8c350735-88b5-4b9d-a30b-43cc279f97d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.170068] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-8c350735-88b5-4b9d-a30b-43cc279f97d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.170068] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c350735-88b5-4b9d-a30b-43cc279f97d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.170890] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.171694] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.171805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.171882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.172665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.172665] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.172665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.172665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.172665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.172665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.173085] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.173085] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.173196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.173269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.173590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.173590] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.173728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.173728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.174128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.174128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.174128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.174128] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.243050] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.243304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.243304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.243583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.243583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.244153] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.244153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.244153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.244288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.244338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.244425] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be updated. [ 1008.283296] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.283433] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.283508] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.283714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.283855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.293375] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: IN_PROGRESS for 2s [ 1008.384280] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 1008.384514] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 deletion is rescheduled due to dependency. [ 1008.384660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.677527] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.677527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.677527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.677527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.677527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.677527] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1008.678340] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.678340] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.678340] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.678506] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.678915] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.679151] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 8c350735-88b5-4b9d-a30b-43cc279f97d1 not found, creating... [ 1008.680432] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.680674] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.680851] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.681144] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.681355] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.681714] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.681955] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.682138] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.682402] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.682612] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.682612] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 8c350735-88b5-4b9d-a30b-43cc279f97d1 is going to be created. [ 1008.683802] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7573caa0-9f71-40fd-82c3-03fa2ce88dbf: rpc.has_security_group_logging(os_id): False [ 1008.722729] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.722861] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.722941] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.723303] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.723534] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.723765] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-8c350735-88b5-4b9d-a30b-43cc279f97d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.733147] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.733147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.733147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.733147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.733147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.733147] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.733147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.733147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.733147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.733147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.733147] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.733147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.733147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.733147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.733147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.733773] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.733773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.733773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.733773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.733773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.733773] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 1008.757836] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.757982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.758072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.758279] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.758425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.767059] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1008.810155] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.810297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.810403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.810571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.810732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.832317] env[68109]: INFO networking_nsxv3.common.synchronization [req-c4d7c425-4896-4e82-bde6-612b84d930e1 req-81f76ebc-6b35-486c-81ed-1a867e3cbf82 service nova] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_rules [ 1008.832499] env[68109]: INFO networking_nsxv3.common.synchronization [req-c4d7c425-4896-4e82-bde6-612b84d930e1 req-81f76ebc-6b35-486c-81ed-1a867e3cbf82 service nova] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1008.832638] env[68109]: INFO networking_nsxv3.common.synchronization [req-c4d7c425-4896-4e82-bde6-612b84d930e1 req-81f76ebc-6b35-486c-81ed-1a867e3cbf82 service nova] Enqueued Resource ID: 6dd44bd6-e830-42f0-85f8-bb7a232ad879 with Priority: HIGHEST for action port [ 1008.833264] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_rules [ 1008.833399] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1008.833499] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd44bd6-e830-42f0-85f8-bb7a232ad879 with Priority: HIGHEST for action port [ 1008.833768] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.833858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.834164] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.834164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.834316] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dd44bd6-e830-42f0-85f8-bb7a232ad879 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.834405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dd44bd6-e830-42f0-85f8-bb7a232ad879" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.834517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dd44bd6-e830-42f0-85f8-bb7a232ad879" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.834648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dd44bd6-e830-42f0-85f8-bb7a232ad879" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.834732] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dd44bd6-e830-42f0-85f8-bb7a232ad879',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.867899] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 1009.337730] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6dd44bd6-e830-42f0-85f8-bb7a232ad879 with status ACTIVE [ 1009.339036] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.339036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.339036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.339036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.339036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.339036] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.339036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.339036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.339036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.339036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.339489] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.339489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.339489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.339626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.339626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.339897] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6dd44bd6-e830-42f0-85f8-bb7a232ad879 is going to be updated. [ 1009.368259] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.368259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.368438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.368564] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.368716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.368882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dd44bd6-e830-42f0-85f8-bb7a232ad879" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.538722] env[68109]: INFO networking_nsxv3.common.synchronization [req-e9600e4a-89ee-4dba-a872-1622683e1157 req-55f512ca-ebad-460c-a110-aff231c91791 service nova] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_rules [ 1009.539046] env[68109]: INFO networking_nsxv3.common.synchronization [req-e9600e4a-89ee-4dba-a872-1622683e1157 req-55f512ca-ebad-460c-a110-aff231c91791 service nova] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 1009.541113] env[68109]: INFO networking_nsxv3.common.synchronization [req-e9600e4a-89ee-4dba-a872-1622683e1157 req-55f512ca-ebad-460c-a110-aff231c91791 service nova] Enqueued Resource ID: 8c350735-88b5-4b9d-a30b-43cc279f97d1 with Priority: HIGHEST for action port [ 1009.541113] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_rules [ 1009.541113] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 1009.541113] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c350735-88b5-4b9d-a30b-43cc279f97d1 with Priority: HIGHEST for action port [ 1009.541911] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.541911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.541911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.541911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.541911] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.543146] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.543494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.543620] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c350735-88b5-4b9d-a30b-43cc279f97d1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.544977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c350735-88b5-4b9d-a30b-43cc279f97d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.544977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c350735-88b5-4b9d-a30b-43cc279f97d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.544977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c350735-88b5-4b9d-a30b-43cc279f97d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.544977] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c350735-88b5-4b9d-a30b-43cc279f97d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.652351] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 1009.652351] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 deletion is rescheduled due to dependency. [ 1009.652351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.046113] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.046287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.047646] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c350735-88b5-4b9d-a30b-43cc279f97d1 with status ACTIVE [ 1010.047830] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.047946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.048028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.049284] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.049389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.049579] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.049681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.049745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.049947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.050021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.050521] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.050521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.050521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.050521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.050698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.050698] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c350735-88b5-4b9d-a30b-43cc279f97d1 is going to be updated. [ 1010.077162] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.077162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.077162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.077162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.077162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.077162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c350735-88b5-4b9d-a30b-43cc279f97d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.304869] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 1010.305077] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 deletion is rescheduled due to dependency. [ 1010.305201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.305366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.305577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.305755] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.306054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.306054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.306179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.306220] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.306303] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.782136] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1010.782136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.782136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.782136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.782136] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.782136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.782136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.782136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.782136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.782136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.782136] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.782136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.782136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.782136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.782864] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.782864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.782864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.782864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.782864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.782864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.783075] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.783771] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.783929] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.785070] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.785070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.785070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.785070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.785070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.785070] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.809733] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.877718] env[68109]: INFO networking_nsxv3.common.synchronization [req-98b647f7-e745-473e-8cd9-6c644b40ad92 req-4ad35093-656e-41c5-a068-fda7a1948e0d tempest-ServersNegativeTestJSON-2006371617 tempest-ServersNegativeTestJSON-2006371617-project-member] Enqueued Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_members [ 1010.878035] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_members [ 1010.878338] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.878462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.878697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.878697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.879382] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.879524] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.879593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.879760] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.879854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.879935] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.881351] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 1010.881542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.286110] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dd7db8b-2c17-4640-bd53-bfb063c83711: rpc.has_security_group_logging(os_id): False [ 1011.287847] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.312705] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.312873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.312985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.313140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.313232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.313413] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.313548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.313631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.313708] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.313785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.313983] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.314125] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.314224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.314422] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.314422] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.314587] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.314587] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.314769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.314769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.315154] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.315300] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be created. [ 1011.316451] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.382744] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.406551] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.406897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.406897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.407046] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.407178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.420899] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1011.790940] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.820231] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.820392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.820442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.820657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.821014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.821014] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be updated. [ 1011.849547] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.849547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.849547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.852949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.852949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.859553] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: IN_PROGRESS for 2s [ 1011.887446] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.296819] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.297269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.297485] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.297809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.298014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.298138] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1012.338676] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.338676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.338676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.338676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.338927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.350878] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1012.389972] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.389972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.389972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.389972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.389972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.390549] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b is going to be updated. [ 1012.420875] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.421020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.421088] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.421303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.421441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.428769] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: IN_PROGRESS for 2s [ 1012.625140] env[68109]: INFO networking_nsxv3.common.synchronization [req-8a292444-dd20-45b0-af2c-d29e91a06a5c req-7b79c0aa-76e6-4f40-9702-b693d97c442b tempest-AttachVolumeShelveTestJSON-1309092891 tempest-AttachVolumeShelveTestJSON-1309092891-project-member] Enqueued Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_members [ 1012.625140] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_members [ 1012.625140] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.625140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.625140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.625140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.625140] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.625140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.625997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.626343] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.626565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.626847] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.128636] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.128956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.128956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.129100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.129194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.129400] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.129498] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.129560] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.129713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.129789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.129874] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 already deleted. [ 1013.129954] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.187461] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.187671] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.187803] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.188106] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.188403] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.188575] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.190343] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.190343] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.190422] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.190621] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.190784] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.190852] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.190965] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.191116] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1013.191246] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.191394] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.208814] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.208980] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1013.209142] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.209320] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.209665] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-1b47e5a5-5481-413d-b98e-9c69d26feef0 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.209849] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.209977] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.210307] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.210453] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b47e5a5-5481-413d-b98e-9c69d26feef0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.434930] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1013.435658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.435878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.436147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.436272] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.713994] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.713994] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.713994] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.714260] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.714401] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.715024] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 1b47e5a5-5481-413d-b98e-9c69d26feef0 not found, creating... [ 1013.715024] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.715024] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.715207] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.715539] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.715611] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.715917] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.716051] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.716268] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.716560] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.716712] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.716866] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 1b47e5a5-5481-413d-b98e-9c69d26feef0 is going to be created. [ 1013.743914] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.744273] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.744413] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.744698] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.744989] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.745311] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.869343] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 1013.869680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.869680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.869902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.870112] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.870237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.870302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.870463] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.870546] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.870635] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.870731] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.942585] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.942817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.361445] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1014.361783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.361843] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.362031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.362241] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.362364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.362437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.362594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.362682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.362775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.362870] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.373217] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.439793] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: SUCCESS [ 1014.440019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.572838] env[68109]: INFO networking_nsxv3.common.synchronization [req-8a292444-dd20-45b0-af2c-d29e91a06a5c req-000270a2-1d91-4df6-ab51-ef89084ba102 service nova] Enqueued Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_rules [ 1014.572838] env[68109]: INFO networking_nsxv3.common.synchronization [req-8a292444-dd20-45b0-af2c-d29e91a06a5c req-000270a2-1d91-4df6-ab51-ef89084ba102 service nova] Enqueued Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_members [ 1014.572838] env[68109]: INFO networking_nsxv3.common.synchronization [req-8a292444-dd20-45b0-af2c-d29e91a06a5c req-000270a2-1d91-4df6-ab51-ef89084ba102 service nova] Enqueued Resource ID: 1b47e5a5-5481-413d-b98e-9c69d26feef0 with Priority: HIGHEST for action port [ 1014.574184] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_rules [ 1014.574349] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_members [ 1014.574596] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b47e5a5-5481-413d-b98e-9c69d26feef0 with Priority: HIGHEST for action port [ 1014.575246] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.575352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.575446] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.575609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.575690] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.576837] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.576952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.577043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.577217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.581030] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.581030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.581030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.581030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.581030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.581030] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.581030] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b47e5a5-5481-413d-b98e-9c69d26feef0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.581030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.581030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.581030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.581030] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b47e5a5-5481-413d-b98e-9c69d26feef0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.865436] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.865625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.865669] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.865890] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.866076] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.866180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.866244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.866403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.866543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.866590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.866776] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.866850] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.866883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.867010] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.867150] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.867242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.867299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.867435] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.867508] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.867586] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.867672] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.874652] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 841d58e8-0316-41e3-a855-66ac66e6d9f4: rpc.has_security_group_logging(os_id): False [ 1014.892939] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.893388] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.893519] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.893815] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.893983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.894295] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.894692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.894769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.894999] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.895097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.895135] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be updated. [ 1014.906266] env[68109]: INFO networking_nsxv3.common.synchronization [None req-8b938d04-e3ce-4850-9ae8-d03dbdab7524 None None] Enqueued Resource ID: f0551e9a-65e4-4467-bf1f-b80aa11ec2b6 with Priority: HIGHEST for action port [ 1014.907518] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0551e9a-65e4-4467-bf1f-b80aa11ec2b6 with Priority: HIGHEST for action port [ 1014.907890] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0551e9a-65e4-4467-bf1f-b80aa11ec2b6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.908203] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0551e9a-65e4-4467-bf1f-b80aa11ec2b6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.908340] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0551e9a-65e4-4467-bf1f-b80aa11ec2b6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.908624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0551e9a-65e4-4467-bf1f-b80aa11ec2b6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.908758] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0551e9a-65e4-4467-bf1f-b80aa11ec2b6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.963968] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.964137] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.964195] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.964408] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.964653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.976099] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: IN_PROGRESS for 2s [ 1015.081092] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.081187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.082533] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b47e5a5-5481-413d-b98e-9c69d26feef0 with status ACTIVE [ 1015.082772] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.082902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.082989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.083535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.083535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.083661] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.083741] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.087026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.087026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.087026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.087026] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.087026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.087026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.087026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.087026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.087026] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b47e5a5-5481-413d-b98e-9c69d26feef0 is going to be updated. [ 1015.087026] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.148840] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.149050] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.149092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.149289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.149434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.149662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.371557] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dd7db8b-2c17-4640-bd53-bfb063c83711: rpc.has_security_group_logging(os_id): False [ 1015.397241] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.398689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.398839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.399117] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.399273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.399547] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.399686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.399989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.400347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.400488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.400730] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.401523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.401523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.401523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.401523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.401523] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.401523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.401523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.401787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.401887] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.401887] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1015.413933] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0551e9a-65e4-4467-bf1f-b80aa11ec2b6 [ 1015.414229] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.414418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.414517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.414800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.414930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.415123] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0551e9a-65e4-4467-bf1f-b80aa11ec2b6 already deleted. [ 1015.415245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0551e9a-65e4-4467-bf1f-b80aa11ec2b6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.488193] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.488193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.488193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.488193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.488193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.507615] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1015.589158] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.645177] env[68109]: INFO networking_nsxv3.common.synchronization [None req-93a72a38-449e-4f27-80cc-022ea72e5584 tempest-AttachInterfacesUnderV243Test-1101867593 tempest-AttachInterfacesUnderV243Test-1101867593-project-member] Enqueued Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_rules [ 1015.645680] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_rules [ 1015.645982] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd411cb2-c40e-46e4-a754-136e1fddced1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.646128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.646213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.646447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.646597] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.730619] env[68109]: INFO networking_nsxv3.common.synchronization [None req-ca814750-d48b-4729-94b7-584c71b3e313 tempest-AttachInterfacesUnderV243Test-1101867593 tempest-AttachInterfacesUnderV243Test-1101867593-project-member] Enqueued Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_rules [ 1015.731722] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_rules [ 1015.731722] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd411cb2-c40e-46e4-a754-136e1fddced1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.731722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.091138] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.091299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.091373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.091638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.091697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.091824] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 is going to be created. [ 1016.116170] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.116170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.116170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.116417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.116417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.126452] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 in Status: UNINITIALIZED for 2s [ 1016.167816] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.167943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.167943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.168290] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.168290] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.168675] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd411cb2-c40e-46e4-a754-136e1fddced1 already deleted. [ 1016.168675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.168675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.168675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.168855] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.501141] env[68109]: INFO networking_nsxv3.common.synchronization [req-ee5ab21a-c3cf-4153-9913-e8b849d07a95 req-1708a468-0aa5-4d38-bb48-53f6e30cc51f tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1016.501722] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1016.502146] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.502290] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.502359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.502601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.502785] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.502893] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.502951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.503150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.503239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.503333] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.707170] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.710190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.710190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.710190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.710190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.710190] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd411cb2-c40e-46e4-a754-136e1fddced1 already deleted. [ 1016.710190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.991751] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 1016.991870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.006674] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.217862] env[68109]: INFO networking_nsxv3.common.synchronization [None req-0dde2a5a-d717-4b0f-8717-22f9529744ce None None] Enqueued Resource ID: 1425a3db-5d38-40c3-91c1-2da3a8b952bc with Priority: HIGHEST for action port [ 1017.218918] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1425a3db-5d38-40c3-91c1-2da3a8b952bc with Priority: HIGHEST for action port [ 1017.218918] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-1425a3db-5d38-40c3-91c1-2da3a8b952bc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.218918] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1425a3db-5d38-40c3-91c1-2da3a8b952bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.218918] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1425a3db-5d38-40c3-91c1-2da3a8b952bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.219468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1425a3db-5d38-40c3-91c1-2da3a8b952bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.219468] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1425a3db-5d38-40c3-91c1-2da3a8b952bc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.487666] env[68109]: INFO networking_nsxv3.common.synchronization [None req-8fe62d02-5368-4f2a-8ac7-68f01fe4830b tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1017.487666] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1017.487666] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.488875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.509965] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.522635] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1017.523073] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.523565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.523772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.523861] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.723031] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1425a3db-5d38-40c3-91c1-2da3a8b952bc [ 1017.723031] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.723186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.723186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.723355] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.723449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.723546] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1425a3db-5d38-40c3-91c1-2da3a8b952bc already deleted. [ 1017.723628] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1425a3db-5d38-40c3-91c1-2da3a8b952bc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.991656] env[68109]: INFO networking_nsxv3.common.synchronization [req-008aa8e6-982e-4447-a8a5-3665f66c61d1 req-96678b6d-0fb0-4956-ac51-c53c663bfa01 tempest-ImagesTestJSON-447768907 tempest-ImagesTestJSON-447768907-project-member] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 1017.991656] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 1017.991656] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.991656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.991656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.991656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.991656] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.991656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.991656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.991656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.991656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.991656] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.013871] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.013871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.013871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.013871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.014156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.014156] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 1018.028251] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.028251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.028251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.028251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.028251] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.028251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.028251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.028251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.028251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.028251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.028251] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.061174] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.061174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.061174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.061174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.061174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.076188] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 1018.144755] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 in Status: SUCCESS [ 1018.144755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.144755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.144755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.144755] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.144755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.144755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.144755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.144755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.144755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.144755] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.500723] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.500723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.500723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.500723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.500723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.500723] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.500723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.500723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.500723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.500723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.500723] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be updated. [ 1018.530477] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.531153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.531346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.531711] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.532122] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.532337] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.532488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.532753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.532932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.533235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.533512] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.533736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.533903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.534190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.534437] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.534677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.534845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.535159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.535350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.535525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.535800] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.537927] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.538248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.538484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.539269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.541249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.550526] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 1018.778780] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.802959] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.803233] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.803366] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.803634] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.803912] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.804123] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.804190] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.804413] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.804558] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.804768] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.804895] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.804990] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.805165] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.805555] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.805626] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.805755] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.826302] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.826302] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.826302] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.826302] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-977" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.826302] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-9b9d89ff-5b35-417d-8b73-1e37979081e3 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.826302] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-9b9d89ff-5b35-417d-8b73-1e37979081e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.826302] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-9b9d89ff-5b35-417d-8b73-1e37979081e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.826643] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-9b9d89ff-5b35-417d-8b73-1e37979081e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.826788] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b9d89ff-5b35-417d-8b73-1e37979081e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.041994] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dd7db8b-2c17-4640-bd53-bfb063c83711: rpc.has_security_group_logging(os_id): False [ 1019.063048] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.063048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.063048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.063048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.063048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.063048] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.063048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.063048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.063048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.063048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.063048] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.063048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.063048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.063048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.067193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.067513] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.067675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.067747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.067930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.068021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.068120] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1019.125520] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.125691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.125754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.126718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.126718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.140151] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1019.280705] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 256c7a06-cd22-48f9-a904-ae2dd6fec0e8: rpc.has_security_group_logging(os_id): False [ 1019.300692] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.301026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.301153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.301405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.301563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.301854] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.302009] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.302120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.302315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.302437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.302561] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 is going to be created. [ 1019.329108] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.329343] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.329561] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.329984] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.330069] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.330261] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 9b9d89ff-5b35-417d-8b73-1e37979081e3 not found, creating... [ 1019.330560] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.330759] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.330917] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.331215] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.331421] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.331744] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.331943] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.332116] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.332369] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.332540] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.332693] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 9b9d89ff-5b35-417d-8b73-1e37979081e3 is going to be created. [ 1019.355023] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.355023] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.355249] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.355620] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.355983] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.356381] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-9b9d89ff-5b35-417d-8b73-1e37979081e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.373134] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.373657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.373657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.373657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.373833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.391550] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 in Status: IN_PROGRESS for 2s [ 1020.086236] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 1020.086486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.087212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.087212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.087212] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.087212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.087212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.087455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.087455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.087515] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.323368] env[68109]: INFO networking_nsxv3.common.synchronization [req-008aa8e6-982e-4447-a8a5-3665f66c61d1 req-0e0036da-e4c8-44da-97af-70c071992a7c service nova] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_rules [ 1020.323368] env[68109]: INFO networking_nsxv3.common.synchronization [req-008aa8e6-982e-4447-a8a5-3665f66c61d1 req-0e0036da-e4c8-44da-97af-70c071992a7c service nova] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 1020.323368] env[68109]: INFO networking_nsxv3.common.synchronization [req-008aa8e6-982e-4447-a8a5-3665f66c61d1 req-0e0036da-e4c8-44da-97af-70c071992a7c service nova] Enqueued Resource ID: 9b9d89ff-5b35-417d-8b73-1e37979081e3 with Priority: HIGHEST for action port [ 1020.323535] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_rules [ 1020.323663] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 1020.323756] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b9d89ff-5b35-417d-8b73-1e37979081e3 with Priority: HIGHEST for action port [ 1020.324037] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.324257] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.324304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.324784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.324784] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.325423] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.325528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.325711] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b9d89ff-5b35-417d-8b73-1e37979081e3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.325812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b9d89ff-5b35-417d-8b73-1e37979081e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.325876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b9d89ff-5b35-417d-8b73-1e37979081e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.326048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b9d89ff-5b35-417d-8b73-1e37979081e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.326858] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b9d89ff-5b35-417d-8b73-1e37979081e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.563346] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 1020.563346] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 deletion is rescheduled due to dependency. [ 1020.563346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.563346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.563346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.563346] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.563346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.563346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.563346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.563346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.563346] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.591921] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.591921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.591921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.591921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.591921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.591921] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.591921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.591921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.591921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.591921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.591921] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 1020.621390] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.621527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.621600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.621811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.621947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.631388] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 1020.828012] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.828188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.828437] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b9d89ff-5b35-417d-8b73-1e37979081e3 with status ACTIVE [ 1020.828821] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.828821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.828821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.829078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.829188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.829367] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.829461] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.829521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.829740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.829740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.829923] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.830104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.830104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.830254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.830329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.830513] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b9d89ff-5b35-417d-8b73-1e37979081e3 is going to be updated. [ 1020.850964] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.851245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.851245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.851381] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.851511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.851657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b9d89ff-5b35-417d-8b73-1e37979081e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.065817] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.157249] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1021.157249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.414347] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 in Status: SUCCESS [ 1021.414347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.568028] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.070114] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.070338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.070434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.070661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.070756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.070875] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be updated. [ 1022.131806] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.131806] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.131806] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.131806] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.131806] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.140330] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 1022.501662] env[68109]: INFO networking_nsxv3.common.synchronization [req-44d46622-1522-4077-9733-2513c05d2974 req-18c128a8-7c87-4854-ba39-4c874cfe85cb tempest-ServersTestMultiNic-1863331152 tempest-ServersTestMultiNic-1863331152-project-member] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1022.506200] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1022.509140] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.509140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.509140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.509140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.509140] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.509140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.509140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.509140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.509140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.509140] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.642498] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 1022.645292] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf deletion is rescheduled due to dependency. [ 1022.645424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.716662] env[68109]: INFO networking_nsxv3.common.synchronization [req-44d46622-1522-4077-9733-2513c05d2974 req-32ed09b4-3205-48ba-9524-1f1e4e567961 tempest-ServersTestMultiNic-1863331152 tempest-ServersTestMultiNic-1863331152-project-member] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1022.717208] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1022.717590] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.719036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.010984] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.216210] env[68109]: INFO networking_nsxv3.common.synchronization [req-f68a00aa-59d8-47d3-835b-2f8c613fc07b req-afa98408-0cea-4e16-affe-4773b162bb7b tempest-ServerDiskConfigTestJSON-1064584538 tempest-ServerDiskConfigTestJSON-1064584538-project-member] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 1023.221021] env[68109]: INFO networking_nsxv3.common.synchronization [req-44d46622-1522-4077-9733-2513c05d2974 req-a599a5cd-6ee1-4179-b8b0-e1b5f79c2075 tempest-ServersTestMultiNic-1863331152 tempest-ServersTestMultiNic-1863331152-project-member] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1023.221021] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 1023.221021] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1023.221021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.221021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.221021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.221021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.221021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.221021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.221021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.221021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.221021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.221021] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.223577] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.224223] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.514497] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.733839] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.733839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.733839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.733839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.733839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.733839] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.733839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.733839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.733839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.733839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.733839] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 1023.758205] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.759208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.759208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.759208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.761034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.768082] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 1023.890516] env[68109]: INFO networking_nsxv3.common.synchronization [None req-4b42b275-12e2-4ff3-8f4f-52bd39f1a236 None None] Enqueued Resource ID: 65ffc54c-a34e-42ad-8b9c-ae3dd24643ce with Priority: HIGHEST for action port [ 1023.892310] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65ffc54c-a34e-42ad-8b9c-ae3dd24643ce with Priority: HIGHEST for action port [ 1023.892693] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-65ffc54c-a34e-42ad-8b9c-ae3dd24643ce taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.893501] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65ffc54c-a34e-42ad-8b9c-ae3dd24643ce" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.895331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65ffc54c-a34e-42ad-8b9c-ae3dd24643ce" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.895331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65ffc54c-a34e-42ad-8b9c-ae3dd24643ce" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.895331] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65ffc54c-a34e-42ad-8b9c-ae3dd24643ce',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.019517] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.019517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.019517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.019517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.019517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.019517] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1024.048674] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.048878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.048929] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.049299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.049398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.060557] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1024.150065] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 1024.150293] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.150556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.150796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.150988] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.151153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.151201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.152299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.152299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.152299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.152299] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.397637] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65ffc54c-a34e-42ad-8b9c-ae3dd24643ce [ 1024.397850] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.397982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.398064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.398694] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.398694] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.398694] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65ffc54c-a34e-42ad-8b9c-ae3dd24643ce already deleted. [ 1024.398694] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65ffc54c-a34e-42ad-8b9c-ae3dd24643ce" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.654843] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.655193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.655193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.655317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.655483] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.655578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.655639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.655787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.655869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.655954] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.656130] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.656229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.656287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.656435] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.656575] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.656665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.656723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.656858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.656933] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.657021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.657111] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.756502] env[68109]: INFO networking_nsxv3.common.synchronization [req-e581b893-052a-4c86-86fd-5602c7ffaa11 req-2357c4ff-ea72-420e-97a8-437408f46dcc tempest-AttachInterfacesUnderV243Test-1101867593 tempest-AttachInterfacesUnderV243Test-1101867593-project-member] Enqueued Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_members [ 1024.757169] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_members [ 1024.757527] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd411cb2-c40e-46e4-a754-136e1fddced1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.757527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.757660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.757842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.757988] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.759200] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.759263] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.759850] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.759850] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.759850] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.145908] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.146091] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-567" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.146149] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-567" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.146457] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-567" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.146733] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.146895] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.147022] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.147247] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.147396] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.147638] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1025.147756] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.147869] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.147978] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.148113] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1025.148225] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.148365] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.162938] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bd26aad-19e8-435d-b39a-5875f3b5cfd7: rpc.has_security_group_logging(os_id): False [ 1025.185429] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.185429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.185429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.185429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.185429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.185429] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.185429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.185429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.185429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.185429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.185429] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.185429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.185429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.185429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.185429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.186053] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.186053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.186053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.186053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.186053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.186053] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be updated. [ 1025.189525] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.189830] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1025.190081] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.190419] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-567" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.190829] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.191261] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.191781] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.192185] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.192563] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('883cba4a-2b86-4af1-baa0-afc92e9fa4b1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.263318] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.263318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.263318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.263318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.263318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.263318] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.263318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.263318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.263318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.263318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.263318] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd411cb2-c40e-46e4-a754-136e1fddced1 already deleted. [ 1025.263318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.294130] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.294536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.296015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.296015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.296015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.324636] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 1025.696368] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.696368] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.696368] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.696882] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.696882] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.697013] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 883cba4a-2b86-4af1-baa0-afc92e9fa4b1 not found, creating... [ 1025.697308] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.697504] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.697625] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.697879] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.698130] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.701446] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.701631] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.701758] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.701984] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.702149] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.702299] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 883cba4a-2b86-4af1-baa0-afc92e9fa4b1 is going to be created. [ 1025.747052] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.747391] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.747536] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.747815] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.748064] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.748300] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.793640] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 1025.793640] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 deletion is rescheduled due to dependency. [ 1025.793640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.070425] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1026.070667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.070827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.071434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.071434] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.071434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.071434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.071645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.071678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.071780] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.340489] env[68109]: INFO networking_nsxv3.common.synchronization [None req-324ded2c-e4b6-4d22-817a-68561c21fdad None None] Enqueued Resource ID: d80a4418-cdaa-4078-abd4-a77a2a61b308 with Priority: HIGHEST for action port [ 1026.340489] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d80a4418-cdaa-4078-abd4-a77a2a61b308 with Priority: HIGHEST for action port [ 1026.340489] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-d80a4418-cdaa-4078-abd4-a77a2a61b308 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.340489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d80a4418-cdaa-4078-abd4-a77a2a61b308" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.340489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d80a4418-cdaa-4078-abd4-a77a2a61b308" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.340489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d80a4418-cdaa-4078-abd4-a77a2a61b308" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.341130] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d80a4418-cdaa-4078-abd4-a77a2a61b308',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.474431] env[68109]: INFO networking_nsxv3.common.synchronization [req-e581b893-052a-4c86-86fd-5602c7ffaa11 req-5ed09977-244f-45fe-9e41-cb3f7a179635 service nova] Enqueued Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_rules [ 1026.474619] env[68109]: INFO networking_nsxv3.common.synchronization [req-e581b893-052a-4c86-86fd-5602c7ffaa11 req-5ed09977-244f-45fe-9e41-cb3f7a179635 service nova] Enqueued Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_members [ 1026.474762] env[68109]: INFO networking_nsxv3.common.synchronization [req-e581b893-052a-4c86-86fd-5602c7ffaa11 req-5ed09977-244f-45fe-9e41-cb3f7a179635 service nova] Enqueued Resource ID: 883cba4a-2b86-4af1-baa0-afc92e9fa4b1 with Priority: HIGHEST for action port [ 1026.475015] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_rules [ 1026.475212] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_members [ 1026.475331] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 883cba4a-2b86-4af1-baa0-afc92e9fa4b1 with Priority: HIGHEST for action port [ 1026.475891] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd411cb2-c40e-46e4-a754-136e1fddced1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.477289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.477452] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.477674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.477764] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.478883] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd411cb2-c40e-46e4-a754-136e1fddced1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.478997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.479125] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.479331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.479530] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.479642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.479721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.479901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.480026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.480171] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.481062] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.481062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.481433] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.481709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.481709] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('883cba4a-2b86-4af1-baa0-afc92e9fa4b1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.577018] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.577018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.577018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.577018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.577018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.577018] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.577018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.577018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.577018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.577018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.577018] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1026.608435] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.610538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.610538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.610538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.610538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.619608] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1026.844851] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d80a4418-cdaa-4078-abd4-a77a2a61b308 [ 1026.844851] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.844851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.844851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.844851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.844851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.844851] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d80a4418-cdaa-4078-abd4-a77a2a61b308 already deleted. [ 1026.844851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d80a4418-cdaa-4078-abd4-a77a2a61b308" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.983373] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd411cb2-c40e-46e4-a754-136e1fddced1 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.983623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.983840] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.984773] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 883cba4a-2b86-4af1-baa0-afc92e9fa4b1 with status ACTIVE [ 1026.988120] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.988120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.988120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.988120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.988120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.988120] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.988120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.988120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.988120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.988120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.988120] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.988120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.988120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.988120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.988120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.988120] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 883cba4a-2b86-4af1-baa0-afc92e9fa4b1 is going to be updated. [ 1026.992021] env[68109]: INFO networking_nsxv3.common.synchronization [req-35a55f0a-aaa5-4f19-a101-9150cb010fab req-69eed6f7-6790-404a-baf2-e1d956a575c8 tempest-DeleteServersTestJSON-2063667557 tempest-DeleteServersTestJSON-2063667557-project-member] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 1026.992021] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 1026.992021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.992021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.992021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.992021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.992021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.992569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.992569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.992699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.992804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.992923] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.008935] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.009207] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.009207] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.009544] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.009544] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.009636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.055782] env[68109]: INFO networking_nsxv3.common.synchronization [None req-a321b2a2-6354-4d8e-9d4d-e4ad19b52228 None None] Enqueued Resource ID: 78fa175f-dc2f-4a3c-b09d-9c1396812a64 with Priority: HIGHEST for action port [ 1027.056573] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fa175f-dc2f-4a3c-b09d-9c1396812a64 with Priority: HIGHEST for action port [ 1027.056672] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-78fa175f-dc2f-4a3c-b09d-9c1396812a64 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.056754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78fa175f-dc2f-4a3c-b09d-9c1396812a64" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.056791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78fa175f-dc2f-4a3c-b09d-9c1396812a64" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.058991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78fa175f-dc2f-4a3c-b09d-9c1396812a64" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.059137] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78fa175f-dc2f-4a3c-b09d-9c1396812a64',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.314329] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-505 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.314536] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.314698] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.314978] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.315698] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.315698] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.315698] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.315882] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.317107] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.317425] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.317577] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.317698] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.317828] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.317963] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.318092] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.318237] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.337965] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 1027.338181] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.343202] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.343281] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1027.343392] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.343570] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-505" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.343890] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-fb9d694d-4f15-4094-aba7-283d55db4796 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.344072] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-fb9d694d-4f15-4094-aba7-283d55db4796" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.344197] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-fb9d694d-4f15-4094-aba7-283d55db4796" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.344518] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-fb9d694d-4f15-4094-aba7-283d55db4796" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.344666] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb9d694d-4f15-4094-aba7-283d55db4796',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.488881] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.497279] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.497427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.497492] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.497696] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.497792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.497988] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.498101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.498168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.498319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.498391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.498533] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 1027.525989] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.525989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.525989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.526229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.526365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.534566] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 1027.562770] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78fa175f-dc2f-4a3c-b09d-9c1396812a64 [ 1027.562770] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.562770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.563066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.564697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.564697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.564697] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78fa175f-dc2f-4a3c-b09d-9c1396812a64 already deleted. [ 1027.564697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78fa175f-dc2f-4a3c-b09d-9c1396812a64" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.733216] env[68109]: INFO networking_nsxv3.common.synchronization [req-b7116aa8-fa40-40af-8e46-acb7b4a3e05d req-864cffee-54af-493a-b18f-4fdf96eda758 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 with Priority: HIGHEST for action security_group_members [ 1027.733216] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 with Priority: HIGHEST for action security_group_members [ 1027.733216] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-15c24162-8d2d-427e-9b29-f175f91a92c1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.733216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.733216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.737183] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.738193] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.738193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.738193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.738193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.738193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.738193] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15c24162-8d2d-427e-9b29-f175f91a92c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.848638] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.849716] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.849716] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.849716] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.849716] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.849942] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port fb9d694d-4f15-4094-aba7-283d55db4796 not found, creating... [ 1027.850244] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.850456] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.850601] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.851039] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.851039] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.851356] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.851616] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.851788] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.852044] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.852226] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.852405] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: fb9d694d-4f15-4094-aba7-283d55db4796 is going to be created. [ 1027.872221] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.872544] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.872653] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.873249] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.873249] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.873493] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-fb9d694d-4f15-4094-aba7-283d55db4796" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.991955] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.992186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.992252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.992447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.992532] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.992634] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd411cb2-c40e-46e4-a754-136e1fddced1 is going to be created. [ 1028.020641] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.020832] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.020904] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.021069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.021677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.045518] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd411cb2-c40e-46e4-a754-136e1fddced1 in Status: UNINITIALIZED for 2s [ 1028.245470] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.245470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.245470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.245470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.245470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.245470] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.245470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.245470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.245470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.245470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.245470] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 is going to be updated. [ 1028.280871] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.280871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.280871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.280871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.280871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.288209] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 in Status: IN_PROGRESS for 2s [ 1028.602663] env[68109]: INFO networking_nsxv3.common.synchronization [req-35a55f0a-aaa5-4f19-a101-9150cb010fab req-e0585bcd-00ed-4d03-b24d-ee0a8175bca2 service nova] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_rules [ 1028.603823] env[68109]: INFO networking_nsxv3.common.synchronization [req-35a55f0a-aaa5-4f19-a101-9150cb010fab req-e0585bcd-00ed-4d03-b24d-ee0a8175bca2 service nova] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 1028.604031] env[68109]: INFO networking_nsxv3.common.synchronization [req-35a55f0a-aaa5-4f19-a101-9150cb010fab req-e0585bcd-00ed-4d03-b24d-ee0a8175bca2 service nova] Enqueued Resource ID: fb9d694d-4f15-4094-aba7-283d55db4796 with Priority: HIGHEST for action port [ 1028.604870] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_rules [ 1028.604870] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 1028.604870] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb9d694d-4f15-4094-aba7-283d55db4796 with Priority: HIGHEST for action port [ 1028.605159] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.605297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.605362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.605559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.605636] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.606818] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.606940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.607193] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb9d694d-4f15-4094-aba7-283d55db4796 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.607285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb9d694d-4f15-4094-aba7-283d55db4796" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.607345] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb9d694d-4f15-4094-aba7-283d55db4796" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.607532] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb9d694d-4f15-4094-aba7-283d55db4796" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.607606] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb9d694d-4f15-4094-aba7-283d55db4796',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.635945] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1028.635945] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 deletion is rescheduled due to dependency. [ 1028.635945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.635945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.635945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.635945] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.635945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.635945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.635945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.635945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.635945] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.111177] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.111177] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.113211] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb9d694d-4f15-4094-aba7-283d55db4796 with status ACTIVE [ 1029.113505] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.114013] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.114133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.114354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.114471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.114848] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.114848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.114848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.114990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.114990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.115814] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.115814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.115814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.115814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.115999] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.115999] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb9d694d-4f15-4094-aba7-283d55db4796 is going to be updated. [ 1029.138163] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.138342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.138417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.138624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.138765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.139182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb9d694d-4f15-4094-aba7-283d55db4796" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.140351] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.140487] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.140556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.140735] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.140880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.140994] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.141189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.141189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.141356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.141641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.141641] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1029.173771] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.173847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.173882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.174176] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.174263] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.187023] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1029.393251] env[68109]: INFO networking_nsxv3.common.synchronization [req-d92b4f84-206e-4875-a66b-459dfbca4385 req-fd29eb88-838c-4dc0-aaf6-4712506cf201 tempest-ServerDiskConfigTestJSON-1064584538 tempest-ServerDiskConfigTestJSON-1064584538-project-member] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 1029.393741] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 1029.394153] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.394528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.394638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.394872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.395108] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.395273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.395336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.395497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.395611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.395731] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.537613] env[68109]: INFO networking_nsxv3.common.synchronization [None req-92ba1730-f4e6-475a-914a-96e7e21b4ee0 None None] Enqueued Resource ID: 808243ff-46fd-4c47-a28f-016388c1a588 with Priority: HIGHEST for action port [ 1029.537613] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 808243ff-46fd-4c47-a28f-016388c1a588 with Priority: HIGHEST for action port [ 1029.537613] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-808243ff-46fd-4c47-a28f-016388c1a588 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.537613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-808243ff-46fd-4c47-a28f-016388c1a588" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.537613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-808243ff-46fd-4c47-a28f-016388c1a588" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.538713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-808243ff-46fd-4c47-a28f-016388c1a588" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.538713] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('808243ff-46fd-4c47-a28f-016388c1a588',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.546683] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 1029.546937] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 deletion is rescheduled due to dependency. [ 1029.547076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.547572] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.548658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.548658] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.548658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.548658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.548658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.548658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.548658] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.869139] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-332 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.870592] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.870592] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.870592] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.870592] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.870592] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.870592] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.870592] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.870943] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.870943] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.871022] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.871144] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.871204] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.871314] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.871740] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.871740] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.889155] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.889743] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1029.889743] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.889743] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-332" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.889943] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-803b244e-3290-4c00-986d-b802e9fd3f35 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.890144] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-803b244e-3290-4c00-986d-b802e9fd3f35" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.890278] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-803b244e-3290-4c00-986d-b802e9fd3f35" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.890613] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-803b244e-3290-4c00-986d-b802e9fd3f35" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.890750] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('803b244e-3290-4c00-986d-b802e9fd3f35',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.899659] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.899659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.899659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.899659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.899659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.899902] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.899902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.899977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.900090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.900158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.900242] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 1029.925116] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.925280] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.925494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.925555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.926396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.936741] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 1030.042129] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 808243ff-46fd-4c47-a28f-016388c1a588 [ 1030.042365] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.042504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.042573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.042790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.042878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.042978] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:808243ff-46fd-4c47-a28f-016388c1a588 already deleted. [ 1030.043357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-808243ff-46fd-4c47-a28f-016388c1a588" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.051118] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.055662] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd411cb2-c40e-46e4-a754-136e1fddced1 in Status: SUCCESS [ 1030.055910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.056344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.056557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.056746] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.056863] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.056928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.057096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.057176] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.057267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.057356] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.298110] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 in Status: SUCCESS [ 1030.298415] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 deletion is rescheduled due to dependency. [ 1030.298415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.395416] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.395673] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.395826] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.396348] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.396348] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.396550] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 803b244e-3290-4c00-986d-b802e9fd3f35 not found, creating... [ 1030.396821] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.396986] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.397122] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.397376] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.397542] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.397850] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.398030] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.398160] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.398368] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.398618] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.398656] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 803b244e-3290-4c00-986d-b802e9fd3f35 is going to be created. [ 1030.416931] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.417200] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.417323] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.417624] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.417869] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.418133] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-803b244e-3290-4c00-986d-b802e9fd3f35" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.553613] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.559224] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.056427] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.056725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.056725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.056878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.056966] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.057089] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 1031.061917] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd411cb2-c40e-46e4-a754-136e1fddced1: rpc.has_security_group_logging(os_id): False [ 1031.082614] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.082777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.082823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.083052] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.083174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.083433] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.083540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.083605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.083782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.083862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.083966] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd411cb2-c40e-46e4-a754-136e1fddced1 is going to be created. [ 1031.100976] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.100976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.100976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.100976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.100976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.111558] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 1031.146824] env[68109]: INFO networking_nsxv3.common.synchronization [req-d92b4f84-206e-4875-a66b-459dfbca4385 req-b526db11-f4ae-4c9e-b683-170b762532ba service nova] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_rules [ 1031.146824] env[68109]: INFO networking_nsxv3.common.synchronization [req-d92b4f84-206e-4875-a66b-459dfbca4385 req-b526db11-f4ae-4c9e-b683-170b762532ba service nova] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 1031.146824] env[68109]: INFO networking_nsxv3.common.synchronization [req-d92b4f84-206e-4875-a66b-459dfbca4385 req-b526db11-f4ae-4c9e-b683-170b762532ba service nova] Enqueued Resource ID: 803b244e-3290-4c00-986d-b802e9fd3f35 with Priority: HIGHEST for action port [ 1031.147117] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_rules [ 1031.147117] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 1031.147183] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 803b244e-3290-4c00-986d-b802e9fd3f35 with Priority: HIGHEST for action port [ 1031.147759] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.147902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.147953] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.148148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.148228] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.150115] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.150259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.150433] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-803b244e-3290-4c00-986d-b802e9fd3f35 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.150525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-803b244e-3290-4c00-986d-b802e9fd3f35" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.150576] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-803b244e-3290-4c00-986d-b802e9fd3f35" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.150754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-803b244e-3290-4c00-986d-b802e9fd3f35" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.150827] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('803b244e-3290-4c00-986d-b802e9fd3f35',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.165460] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.165460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.165460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.165460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.165793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.189585] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd411cb2-c40e-46e4-a754-136e1fddced1 in Status: IN_PROGRESS for 2s [ 1031.198589] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1031.198756] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 deletion is rescheduled due to dependency. [ 1031.198863] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.653038] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.653460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.655866] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 803b244e-3290-4c00-986d-b802e9fd3f35 with status ACTIVE [ 1031.656144] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.656398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.656538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.656830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.656968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.657183] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.657362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.657444] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.657667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.657822] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.658013] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.658174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.658253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.658379] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.658523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.658587] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 803b244e-3290-4c00-986d-b802e9fd3f35 is going to be updated. [ 1031.686049] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.686049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.686049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.686049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.686049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.686416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-803b244e-3290-4c00-986d-b802e9fd3f35" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.947061] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 1031.947237] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 deletion is rescheduled due to dependency. [ 1031.947362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.947524] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.947734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.947909] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.948033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.948097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.948244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.948323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.948414] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.450572] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.957590] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.069089] env[68109]: INFO networking_nsxv3.common.synchronization [None req-6dcc2df6-b2bd-4a19-899d-5923346f7457 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_rules [ 1033.069838] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_rules [ 1033.070181] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690e6efd-f18b-488b-b84c-5caae41cc733 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.070307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.070371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.070650] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.070757] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.120150] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 1033.120391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.120514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.121035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.121035] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.121387] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.121387] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.121387] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.124164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.124164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.124164] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.155485] env[68109]: INFO networking_nsxv3.common.synchronization [None req-b837acc4-67a2-44f5-9e4a-b9500ea6b8bb tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_rules [ 1033.156357] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_rules [ 1033.156699] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690e6efd-f18b-488b-b84c-5caae41cc733 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.156856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.199467] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd411cb2-c40e-46e4-a754-136e1fddced1 in Status: SUCCESS [ 1033.199957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.463424] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.463600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.463600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.463865] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.463962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.464086] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 1033.491076] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.491238] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.491445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.491685] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.491828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.502582] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 1033.591731] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.591731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.591731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.592179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.592179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.592179] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690e6efd-f18b-488b-b84c-5caae41cc733 already deleted. [ 1033.592179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.592416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.592416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.592528] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.626530] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.626721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.626844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.627144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.627415] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.627653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.627734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.627932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.628059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.628168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.628350] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.628517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.628517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.628651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.628786] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.628876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.629155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.629327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.629472] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.629472] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.629741] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.114965] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.115364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.115468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.115707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.115809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.115931] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690e6efd-f18b-488b-b84c-5caae41cc733 already deleted. [ 1034.116048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.135656] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3775fbff-3109-41e9-a7b4-71b12133d9f0: rpc.has_security_group_logging(os_id): False [ 1034.163948] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.164091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.164155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.164359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.164442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.164667] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.164756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.164826] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.164963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.165052] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.165285] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.165383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.165457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.165600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.165670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.165936] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.166391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.166511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.166726] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.166842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.166956] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 1034.235196] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.235196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.235196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.235196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.235196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.249569] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 1035.512775] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 1035.513424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.513770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.514153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.514507] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.514903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.515152] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.515488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.515720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.515967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.516614] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.683082] env[68109]: INFO networking_nsxv3.common.synchronization [req-3572031a-5608-4944-a9a7-26ed55374b44 req-3a7486b7-764e-4569-b122-fd3695588f39 tempest-ServersAdminTestJSON-278829923 tempest-ServersAdminTestJSON-278829923-project-member] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1035.683661] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1035.683843] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.683963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.684063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.684341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.684499] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.684592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.684646] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.684926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.684926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.685596] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.992164] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.992368] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.992498] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.992844] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.993127] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.993347] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.993391] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.993614] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.993779] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.993991] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1035.994127] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1035.994241] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1035.994352] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1035.994467] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1035.994575] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1035.994709] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1036.013330] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1036.013559] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1036.013647] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1036.013812] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.014127] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-c456063c-f94d-45e3-8e34-d465681ecc82 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.014307] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-c456063c-f94d-45e3-8e34-d465681ecc82" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.014431] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-c456063c-f94d-45e3-8e34-d465681ecc82" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.014740] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-c456063c-f94d-45e3-8e34-d465681ecc82" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.014882] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c456063c-f94d-45e3-8e34-d465681ecc82',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.018301] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.018424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.018525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.018662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.018811] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.018908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.018970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.019131] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.019213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.019299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.019448] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.019539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.019606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.019734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.019869] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.019960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.020031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.020168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.020235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.020315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.020400] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.188145] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.188145] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.188145] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.188145] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.188145] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.188375] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.188375] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.188375] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.188569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.188601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.188684] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 already deleted. [ 1036.188761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.264949] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 1036.265199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.517434] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.517735] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.517792] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.518044] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.518199] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.518361] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port c456063c-f94d-45e3-8e34-d465681ecc82 not found, creating... [ 1036.518626] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.519015] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.519015] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.519123] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.519265] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.519591] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.519786] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.519912] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.520142] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.520283] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.520489] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: c456063c-f94d-45e3-8e34-d465681ecc82 is going to be created. [ 1036.522479] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7eff74c-b690-47ef-ba84-9ec9d2765c99: rpc.has_security_group_logging(os_id): False [ 1036.539236] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.539353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.539433] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.539604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.539691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.539882] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.539992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.540065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.540194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.540271] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.540488] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.540569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.540625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.540762] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.540836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.541015] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.545747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.545820] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.546069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.546069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.546225] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 1036.548501] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.548737] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.548984] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.551008] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.551168] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.551410] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-c456063c-f94d-45e3-8e34-d465681ecc82" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.620289] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.620521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.620521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.620758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.620871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.641638] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 1037.500934] env[68109]: INFO networking_nsxv3.common.synchronization [req-3572031a-5608-4944-a9a7-26ed55374b44 req-6946bb54-5fa4-4bc9-b2c6-2ade3e77127c service nova] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_rules [ 1037.500934] env[68109]: INFO networking_nsxv3.common.synchronization [req-3572031a-5608-4944-a9a7-26ed55374b44 req-6946bb54-5fa4-4bc9-b2c6-2ade3e77127c service nova] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1037.501212] env[68109]: INFO networking_nsxv3.common.synchronization [req-3572031a-5608-4944-a9a7-26ed55374b44 req-6946bb54-5fa4-4bc9-b2c6-2ade3e77127c service nova] Enqueued Resource ID: c456063c-f94d-45e3-8e34-d465681ecc82 with Priority: HIGHEST for action port [ 1037.503347] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_rules [ 1037.503347] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1037.503347] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c456063c-f94d-45e3-8e34-d465681ecc82 with Priority: HIGHEST for action port [ 1037.503347] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.503347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.503347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.503347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.503347] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.504726] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.504847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.504913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.505216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.505358] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.505474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.505648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.505823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.506118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.506246] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.510354] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-c456063c-f94d-45e3-8e34-d465681ecc82 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.510354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c456063c-f94d-45e3-8e34-d465681ecc82" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.510354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c456063c-f94d-45e3-8e34-d465681ecc82" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.510354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c456063c-f94d-45e3-8e34-d465681ecc82" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.510354] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c456063c-f94d-45e3-8e34-d465681ecc82',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.835604] env[68109]: INFO networking_nsxv3.common.synchronization [req-ac5bb1de-44a9-431d-93f4-013deda4fd7d req-4b204c19-c069-4b5a-b894-48ef629e7e67 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_members [ 1037.836182] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_members [ 1037.836498] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.836976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.837104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.837334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.837505] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.837633] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.837733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.837848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.837952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.838048] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.005356] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.005563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.009278] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.010199] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c456063c-f94d-45e3-8e34-d465681ecc82 with status ACTIVE [ 1038.010399] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.010520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.010580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.010796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.010901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.011109] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.011277] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.011277] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.011426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.011506] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.011686] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.013586] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.013586] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.013586] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.013586] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.013786] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c456063c-f94d-45e3-8e34-d465681ecc82 is going to be updated. [ 1038.043348] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.043348] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.043348] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.043348] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.043550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.043587] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c456063c-f94d-45e3-8e34-d465681ecc82" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.117402] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.117598] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.117773] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.118174] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.118475] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.118639] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.118763] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.119095] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.119221] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.119437] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.119597] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.119718] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.119827] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.119948] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.120072] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.120214] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.144372] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.144372] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1038.144372] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.144713] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.144790] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-5d84f89f-aa4f-494e-a23d-40a485a046ef taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.144941] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-5d84f89f-aa4f-494e-a23d-40a485a046ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.145086] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-5d84f89f-aa4f-494e-a23d-40a485a046ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.145481] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-5d84f89f-aa4f-494e-a23d-40a485a046ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.145639] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d84f89f-aa4f-494e-a23d-40a485a046ef',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.341038] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.341038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.341209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.341336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.341380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.341577] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.341674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.341735] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.341884] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.341958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.342058] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c already deleted. [ 1038.342140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.516317] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.649321] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.649321] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.649321] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.649321] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.649321] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.649586] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 5d84f89f-aa4f-494e-a23d-40a485a046ef not found, creating... [ 1038.649620] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.650551] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.650551] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.650551] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.650551] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.650551] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.650799] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.650878] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.651688] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.651688] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.651688] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 5d84f89f-aa4f-494e-a23d-40a485a046ef is going to be created. [ 1038.654622] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 1038.654899] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.668506] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.668715] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.668844] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.669133] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.669366] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.669592] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-5d84f89f-aa4f-494e-a23d-40a485a046ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.018590] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.018978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.018978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.019102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.019155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.019250] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be created. [ 1039.042039] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.042193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.042264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.042469] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.042627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.051614] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: UNINITIALIZED for 2s [ 1039.370741] env[68109]: INFO networking_nsxv3.common.synchronization [req-ac5bb1de-44a9-431d-93f4-013deda4fd7d req-5f0f1044-66ba-48c9-9956-303b374da8ee service nova] Enqueued Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_rules [ 1039.371014] env[68109]: INFO networking_nsxv3.common.synchronization [req-ac5bb1de-44a9-431d-93f4-013deda4fd7d req-5f0f1044-66ba-48c9-9956-303b374da8ee service nova] Enqueued Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_members [ 1039.371180] env[68109]: INFO networking_nsxv3.common.synchronization [req-ac5bb1de-44a9-431d-93f4-013deda4fd7d req-5f0f1044-66ba-48c9-9956-303b374da8ee service nova] Enqueued Resource ID: 5d84f89f-aa4f-494e-a23d-40a485a046ef with Priority: HIGHEST for action port [ 1039.371697] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_rules [ 1039.371833] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_members [ 1039.371927] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d84f89f-aa4f-494e-a23d-40a485a046ef with Priority: HIGHEST for action port [ 1039.372214] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.372334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.372396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.372662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.372744] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.373658] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.373756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.373818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.373996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.374173] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.374248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.374300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.374425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.374507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.374631] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.375316] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d84f89f-aa4f-494e-a23d-40a485a046ef taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.375635] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d84f89f-aa4f-494e-a23d-40a485a046ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.376096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d84f89f-aa4f-494e-a23d-40a485a046ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.376096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d84f89f-aa4f-494e-a23d-40a485a046ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.376385] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d84f89f-aa4f-494e-a23d-40a485a046ef',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.755066] env[68109]: INFO networking_nsxv3.common.synchronization [req-6df91e8c-4f0b-4759-8a2b-2f16fb344e80 req-f4c67c0e-832e-443d-a9aa-c93673c2a538 tempest-ServersAdminTestJSON-278829923 tempest-ServersAdminTestJSON-278829923-project-member] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1039.755772] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1039.755898] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.755998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.879406] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.879618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.879875] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.881042] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d84f89f-aa4f-494e-a23d-40a485a046ef with status ACTIVE [ 1039.881294] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.881448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.881536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.881791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.881913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.882139] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.882273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.882355] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.882563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.882670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.883037] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.883178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.883264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.883451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.883553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.883662] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d84f89f-aa4f-494e-a23d-40a485a046ef is going to be updated. [ 1039.903196] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.903488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.903589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.903785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.904448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.904686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d84f89f-aa4f-494e-a23d-40a485a046ef" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.303959] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.304271] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.304352] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.304601] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.304862] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.305243] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.305469] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.305708] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.305866] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.306292] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1040.306468] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.306602] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.306719] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.306840] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1040.307118] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.307308] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.330198] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.330378] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1040.330553] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.330765] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.331102] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-ad8e0ef5-0d46-4827-95b0-1cca997e3c58 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.331284] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-ad8e0ef5-0d46-4827-95b0-1cca997e3c58" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.331412] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-ad8e0ef5-0d46-4827-95b0-1cca997e3c58" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.331744] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-ad8e0ef5-0d46-4827-95b0-1cca997e3c58" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.331889] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad8e0ef5-0d46-4827-95b0-1cca997e3c58',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.386104] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.423353] env[68109]: INFO networking_nsxv3.common.synchronization [req-bd77d228-e4c2-46cf-b199-cb5f228dc4e2 req-f73a0b06-9d80-4f90-8287-47acfb5c0919 tempest-ImagesTestJSON-447768907 tempest-ImagesTestJSON-447768907-project-member] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 1040.423941] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGHEST for action security_group_members [ 1040.424338] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.424443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.424501] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.424693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.425312] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.425312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.425312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.425533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.425570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.425667] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.834930] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.835168] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.835296] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.835662] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.835814] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.835979] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port ad8e0ef5-0d46-4827-95b0-1cca997e3c58 not found, creating... [ 1040.836235] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.836401] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.836517] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.836731] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.836869] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.837162] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.837320] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.837438] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.837699] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.837865] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.838023] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: ad8e0ef5-0d46-4827-95b0-1cca997e3c58 is going to be created. [ 1040.889072] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.889290] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.889402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.889661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.889757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.889891] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c is going to be created. [ 1040.927814] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.927983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.928114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.928358] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.928475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.928693] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.928836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.928909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.929092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.929172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.929260] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be updated. [ 1040.963763] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.963927] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.963927] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.964316] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.964502] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.964672] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-ad8e0ef5-0d46-4827-95b0-1cca997e3c58" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.972480] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.972605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.972683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.972848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.972993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.975430] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.975430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.975571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.975605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.975721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.981871] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c in Status: UNINITIALIZED for 2s [ 1040.982459] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: IN_PROGRESS for 2s [ 1041.060858] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1041.061113] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.061275] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.061494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.061677] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.061806] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.061850] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.061997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.062089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.062177] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.062274] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.064497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.064497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.064497] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.064497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.064497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.064497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.064497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.064497] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.555110] env[68109]: INFO networking_nsxv3.common.synchronization [req-6df91e8c-4f0b-4759-8a2b-2f16fb344e80 req-19adacff-4240-442a-927a-5e1b6ed6f901 service nova] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_rules [ 1041.555110] env[68109]: INFO networking_nsxv3.common.synchronization [req-6df91e8c-4f0b-4759-8a2b-2f16fb344e80 req-19adacff-4240-442a-927a-5e1b6ed6f901 service nova] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1041.555110] env[68109]: INFO networking_nsxv3.common.synchronization [req-6df91e8c-4f0b-4759-8a2b-2f16fb344e80 req-19adacff-4240-442a-927a-5e1b6ed6f901 service nova] Enqueued Resource ID: ad8e0ef5-0d46-4827-95b0-1cca997e3c58 with Priority: HIGHEST for action port [ 1041.555690] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_rules [ 1041.555996] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1041.556418] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad8e0ef5-0d46-4827-95b0-1cca997e3c58 with Priority: HIGHEST for action port [ 1041.556616] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.556727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.556901] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.556993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.557266] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad8e0ef5-0d46-4827-95b0-1cca997e3c58 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.557384] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad8e0ef5-0d46-4827-95b0-1cca997e3c58" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.557444] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad8e0ef5-0d46-4827-95b0-1cca997e3c58" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.559117] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad8e0ef5-0d46-4827-95b0-1cca997e3c58" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.559117] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad8e0ef5-0d46-4827-95b0-1cca997e3c58',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.566708] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.567999] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.568184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.060019] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad8e0ef5-0d46-4827-95b0-1cca997e3c58 with status ACTIVE [ 1042.060311] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.060453] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.060523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.060761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.060851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.061062] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.061649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.061649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.061649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.061649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.061649] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.062076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.062076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.062076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.062076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.062076] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad8e0ef5-0d46-4827-95b0-1cca997e3c58 is going to be updated. [ 1042.069881] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.092887] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.093144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.093144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.093317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.093502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.093621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad8e0ef5-0d46-4827-95b0-1cca997e3c58" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.152267] env[68109]: INFO networking_nsxv3.common.synchronization [req-5c1586ab-29f0-4392-8412-725ad52bc1eb req-e2743e12-3158-4603-b5b6-dc433b8cd94d tempest-ServersTestMultiNic-1863331152 tempest-ServersTestMultiNic-1863331152-project-member] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1042.152267] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1042.152267] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.152267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.152267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.152267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.152267] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.152267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.152267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.152267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.152267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.152267] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.439653] env[68109]: INFO networking_nsxv3.common.synchronization [req-5c1586ab-29f0-4392-8412-725ad52bc1eb req-64426482-c753-455a-8db4-2ce4d474ff9f tempest-ServersTestMultiNic-1863331152 tempest-ServersTestMultiNic-1863331152-project-member] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1042.440308] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1042.440893] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.440984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.572603] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.572875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.572875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.573067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.573336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.573490] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be updated. [ 1042.611190] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.611413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.611520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.611879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.612033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.634348] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1042.655131] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.655131] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.655131] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.655131] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.655131] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.655409] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.655475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.655623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.655944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.656066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.656166] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1042.700028] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.700028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.700028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.700028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.700028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.709631] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1042.746283] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.746442] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-548" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.746534] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-548" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.746880] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-548" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.747165] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.747328] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.747447] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.747703] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.747876] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.748106] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1042.748227] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.748366] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.748448] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.748569] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1042.748676] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.748809] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.766849] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.767021] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1042.767222] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.767334] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-548" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.767647] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-a628be4e-abd7-4490-aa64-f26035375627 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.767818] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-a628be4e-abd7-4490-aa64-f26035375627" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.767942] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-a628be4e-abd7-4490-aa64-f26035375627" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.768261] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-a628be4e-abd7-4490-aa64-f26035375627" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.768409] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a628be4e-abd7-4490-aa64-f26035375627',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.997160] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c in Status: SUCCESS [ 1042.997396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.997594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.997820] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.998016] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.998138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.998197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.998346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.998428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.998515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.998608] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.000078] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 in Status: SUCCESS [ 1043.000245] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 deletion is rescheduled due to dependency. [ 1043.000346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.271673] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.271673] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.271673] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.271975] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.271975] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.272182] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port a628be4e-abd7-4490-aa64-f26035375627 not found, creating... [ 1043.272428] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.272607] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.272732] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.272978] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.273152] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.273459] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.273630] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.273752] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.274071] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.274254] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.274422] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: a628be4e-abd7-4490-aa64-f26035375627 is going to be created. [ 1043.294400] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.294642] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.294783] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.295141] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.295368] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.295667] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-a628be4e-abd7-4490-aa64-f26035375627" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.501570] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.501978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.501978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.502235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.502482] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.502643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.502730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.502939] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.503302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.503302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.503714] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.503714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.503714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.503962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.503962] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.504100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.504100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.504280] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.504408] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.504548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.504658] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.006882] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b323145-eb80-4cd0-b113-05cefe5e7b4c: rpc.has_security_group_logging(os_id): False [ 1044.016414] env[68109]: INFO networking_nsxv3.common.synchronization [req-5c1586ab-29f0-4392-8412-725ad52bc1eb req-276c64db-77c4-4a36-bc1f-76fb6adf889e service nova] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_rules [ 1044.016414] env[68109]: INFO networking_nsxv3.common.synchronization [req-5c1586ab-29f0-4392-8412-725ad52bc1eb req-276c64db-77c4-4a36-bc1f-76fb6adf889e service nova] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1044.016414] env[68109]: INFO networking_nsxv3.common.synchronization [req-5c1586ab-29f0-4392-8412-725ad52bc1eb req-276c64db-77c4-4a36-bc1f-76fb6adf889e service nova] Enqueued Resource ID: a628be4e-abd7-4490-aa64-f26035375627 with Priority: HIGHEST for action port [ 1044.016414] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_rules [ 1044.018554] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1044.018554] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a628be4e-abd7-4490-aa64-f26035375627 with Priority: HIGHEST for action port [ 1044.018554] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.018554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.018554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.018554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.018554] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.019124] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.019124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.019124] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-a628be4e-abd7-4490-aa64-f26035375627 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.019444] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a628be4e-abd7-4490-aa64-f26035375627" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.019444] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a628be4e-abd7-4490-aa64-f26035375627" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.019444] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a628be4e-abd7-4490-aa64-f26035375627" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.019920] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a628be4e-abd7-4490-aa64-f26035375627',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.024154] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.024305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.024369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.024537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.024634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.024861] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.025078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.025159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.025455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.025455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.025667] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.025745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.025815] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.025947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.026046] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.026232] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.026412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.026479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.026614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.026690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.026855] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c is going to be created. [ 1044.088503] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.088711] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.088753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.088996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.089201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.104946] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c in Status: IN_PROGRESS for 2s [ 1044.522537] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.522835] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.522965] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a628be4e-abd7-4490-aa64-f26035375627 with status ACTIVE [ 1044.523075] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.523173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.523243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.523537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.523647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.523808] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.523920] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.523963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.524144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.524228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.524454] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.524643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.524751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.524897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.524993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.525082] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a628be4e-abd7-4490-aa64-f26035375627 is going to be updated. [ 1044.544826] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.545086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.545157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.545497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.545649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.545849] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a628be4e-abd7-4490-aa64-f26035375627" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.608794] env[68109]: INFO networking_nsxv3.common.synchronization [req-9833a141-a174-4474-9c21-92a5197259ff req-4f6e34a4-b052-41d8-bf22-9609454a88b1 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_members [ 1044.609348] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_members [ 1044.609658] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e6efd-f18b-488b-b84c-5caae41cc733 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.609793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.609915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.610448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.610613] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.610722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.610786] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.610950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.611042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.611135] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.640063] env[68109]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1044.640320] env[68109]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] NSXv3 Agent Agent loop - iteration:2 started [ 1044.648040] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1044.648270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.648342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.648537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.648754] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.648898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.648967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.649101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.649182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.649316] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.723738] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1044.723934] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 deletion is rescheduled due to dependency. [ 1044.724080] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.725096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.725096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.725096] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.725096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.725096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.725096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.725096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.725561] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.830471] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-330 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.830870] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-330" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.834184] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-330" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.834576] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-330" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.834885] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.835141] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.835282] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.835550] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.835708] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.835931] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.836068] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.836249] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.836379] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.836530] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.836651] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.837120] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.854789] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.854971] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1044.855129] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.855313] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-330" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.855680] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-39401f0c-f22a-4b65-b702-d027303dab7f taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.855935] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-39401f0c-f22a-4b65-b702-d027303dab7f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.856089] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-39401f0c-f22a-4b65-b702-d027303dab7f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.856438] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-39401f0c-f22a-4b65-b702-d027303dab7f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.856610] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39401f0c-f22a-4b65-b702-d027303dab7f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.042211] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.042546] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.042645] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.042946] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.044683] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.044960] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.045199] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.045506] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.045692] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.045902] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1045.046037] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1045.046171] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1045.046329] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1045.046472] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1045.046633] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1045.046778] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1045.065316] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1045.066466] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1045.066466] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1045.066466] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.066466] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-dba6fbea-6cc7-4b2a-bc2b-479e244650b7 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.066635] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-dba6fbea-6cc7-4b2a-bc2b-479e244650b7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.066669] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-dba6fbea-6cc7-4b2a-bc2b-479e244650b7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.069074] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-dba6fbea-6cc7-4b2a-bc2b-479e244650b7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.069074] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dba6fbea-6cc7-4b2a-bc2b-479e244650b7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.113671] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.113838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.113906] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.114151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.114239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.114637] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.114637] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.114637] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.114811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.114811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.114878] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e6efd-f18b-488b-b84c-5caae41cc733 already deleted. [ 1045.114973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.147976] env[68109]: INFO networking_nsxv3.common.synchronization [req-b365a44a-40fb-4fe8-8377-55935fc30213 req-d298ba66-c224-4a32-945f-995d32209490 tempest-ServerDiskConfigTestJSON-1064584538 tempest-ServerDiskConfigTestJSON-1064584538-project-member] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 1045.148779] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGHEST for action security_group_members [ 1045.149159] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.149333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.149411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.149641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.149797] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.149954] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.150052] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.150353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.150465] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.150581] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.155284] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.228947] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.358835] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.359097] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.359233] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.359615] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.359698] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.359823] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 39401f0c-f22a-4b65-b702-d027303dab7f not found, creating... [ 1045.360200] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.360394] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.360526] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.360757] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.360902] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.361207] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.361366] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.361485] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.361724] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.361919] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.362116] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 39401f0c-f22a-4b65-b702-d027303dab7f is going to be created. [ 1045.380729] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.380995] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.381176] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.381490] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.381765] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.382123] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-39401f0c-f22a-4b65-b702-d027303dab7f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.570594] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.570872] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.571160] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.571483] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.571671] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.571885] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port dba6fbea-6cc7-4b2a-bc2b-479e244650b7 not found, creating... [ 1045.572222] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.572447] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.572618] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.572889] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.573124] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.573700] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.573981] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.574176] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.574433] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.574609] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.574845] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: dba6fbea-6cc7-4b2a-bc2b-479e244650b7 is going to be created. [ 1045.604993] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.605257] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.605397] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.605761] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.605998] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.606264] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-dba6fbea-6cc7-4b2a-bc2b-479e244650b7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.656166] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.656376] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.656448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.656653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.656750] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.656953] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.657070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.657135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.657289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.657366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.657457] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be updated. [ 1045.658614] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.721016] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.721678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.721800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.721991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.722157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.731015] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.738186] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: IN_PROGRESS for 2s [ 1046.117993] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c in Status: SUCCESS [ 1046.118457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.149867] env[68109]: INFO networking_nsxv3.common.synchronization [req-5c1586ab-29f0-4392-8412-725ad52bc1eb req-bf5c85e7-1b9f-48b3-99c2-0b3730f6a191 service nova] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_rules [ 1046.150527] env[68109]: INFO networking_nsxv3.common.synchronization [req-5c1586ab-29f0-4392-8412-725ad52bc1eb req-bf5c85e7-1b9f-48b3-99c2-0b3730f6a191 service nova] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1046.150527] env[68109]: INFO networking_nsxv3.common.synchronization [req-5c1586ab-29f0-4392-8412-725ad52bc1eb req-bf5c85e7-1b9f-48b3-99c2-0b3730f6a191 service nova] Enqueued Resource ID: 39401f0c-f22a-4b65-b702-d027303dab7f with Priority: HIGHEST for action port [ 1046.150928] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_rules [ 1046.151829] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1046.152007] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39401f0c-f22a-4b65-b702-d027303dab7f with Priority: HIGHEST for action port [ 1046.152367] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.152515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.152750] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.152847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.153101] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-39401f0c-f22a-4b65-b702-d027303dab7f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.153224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39401f0c-f22a-4b65-b702-d027303dab7f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.153301] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39401f0c-f22a-4b65-b702-d027303dab7f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.153587] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39401f0c-f22a-4b65-b702-d027303dab7f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.153690] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39401f0c-f22a-4b65-b702-d027303dab7f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.160721] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.160906] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.160993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.161282] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.161399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.161531] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be updated. [ 1046.192199] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.192342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.192412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.192622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.192767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.202555] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1046.234018] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.234173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.234243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.234452] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.234536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.234633] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1046.264533] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.264722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.264795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.265029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.265172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.276013] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1046.306605] env[68109]: INFO networking_nsxv3.common.synchronization [req-9833a141-a174-4474-9c21-92a5197259ff req-1c5a343a-c35c-465d-bc15-8d07c5b9105b service nova] Enqueued Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_rules [ 1046.306847] env[68109]: INFO networking_nsxv3.common.synchronization [req-9833a141-a174-4474-9c21-92a5197259ff req-1c5a343a-c35c-465d-bc15-8d07c5b9105b service nova] Enqueued Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_members [ 1046.307028] env[68109]: INFO networking_nsxv3.common.synchronization [req-9833a141-a174-4474-9c21-92a5197259ff req-1c5a343a-c35c-465d-bc15-8d07c5b9105b service nova] Enqueued Resource ID: dba6fbea-6cc7-4b2a-bc2b-479e244650b7 with Priority: HIGHEST for action port [ 1046.307270] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_rules [ 1046.307461] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_members [ 1046.307591] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba6fbea-6cc7-4b2a-bc2b-479e244650b7 with Priority: HIGHEST for action port [ 1046.308234] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690e6efd-f18b-488b-b84c-5caae41cc733 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.308302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.308359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.308574] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.308619] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.309512] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e6efd-f18b-488b-b84c-5caae41cc733 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.309734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.309734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.309913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.310011] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.310139] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.310221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.310370] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.310455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.310563] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.311335] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-dba6fbea-6cc7-4b2a-bc2b-479e244650b7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.311482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dba6fbea-6cc7-4b2a-bc2b-479e244650b7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.311539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dba6fbea-6cc7-4b2a-bc2b-479e244650b7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.314723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dba6fbea-6cc7-4b2a-bc2b-479e244650b7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.314723] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dba6fbea-6cc7-4b2a-bc2b-479e244650b7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.655687] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39401f0c-f22a-4b65-b702-d027303dab7f with status ACTIVE [ 1046.656191] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.656440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.656752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.656925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.657075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.657312] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.657452] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.657589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.657803] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.657929] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.658180] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.658304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.658370] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.658523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.658625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.658718] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39401f0c-f22a-4b65-b702-d027303dab7f is going to be updated. [ 1046.696118] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.696613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.696799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.697067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.697273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.697507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39401f0c-f22a-4b65-b702-d027303dab7f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.814255] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e6efd-f18b-488b-b84c-5caae41cc733 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.814399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.814598] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.817394] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dba6fbea-6cc7-4b2a-bc2b-479e244650b7 with status ACTIVE [ 1046.817394] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.817394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.817394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.817394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.817394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.817394] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.817394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.817394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.817394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.817394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.818045] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.818045] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.818045] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.818045] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.818045] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.818045] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dba6fbea-6cc7-4b2a-bc2b-479e244650b7 is going to be updated. [ 1046.841309] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.841451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.841539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.841725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.841874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.842072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dba6fbea-6cc7-4b2a-bc2b-479e244650b7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.317370] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.748733] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 in Status: SUCCESS [ 1047.748925] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 deletion is rescheduled due to dependency. [ 1047.749040] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.822790] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.823040] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.823040] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.823266] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.823377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.823520] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e6efd-f18b-488b-b84c-5caae41cc733 is going to be created. [ 1047.845883] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.846097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.846097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.846316] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.846509] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.854730] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e6efd-f18b-488b-b84c-5caae41cc733 in Status: UNINITIALIZED for 2s [ 1048.214027] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1048.214027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.214027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.214027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.214027] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.214027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.214027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.214027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.214027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.214027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.214027] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.214027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.214027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.214027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.214027] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.216380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.216599] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.217140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.217882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.217882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.217882] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.286969] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1048.287673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.287673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.287848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.288117] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.288286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.288441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.288635] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.288748] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.288852] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.724584] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f55a1eeb-30c3-44c5-bd92-57dad54e2585: rpc.has_security_group_logging(os_id): False [ 1048.745104] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.745274] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.745391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.746034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.746034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.746235] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.746235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.746235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.746379] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.746457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.746664] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.746759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.746821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.746962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.747065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.747652] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.747652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.747652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.747652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.747878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.747878] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be created. [ 1048.791440] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.812820] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.812972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.813073] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.813258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.813468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.825284] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1049.292717] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.795219] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.795540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.795540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.795780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.795868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.795972] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1049.839343] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.839511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.839578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.839764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.839981] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.851101] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1049.867139] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e6efd-f18b-488b-b84c-5caae41cc733 in Status: SUCCESS [ 1049.867358] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.867590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.867899] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.868111] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.868232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.868300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.868456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.868538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.868631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.868723] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.372017] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.840480] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1050.840821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.841306] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.842679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.842679] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.879724] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 690e6efd-f18b-488b-b84c-5caae41cc733: rpc.has_security_group_logging(os_id): False [ 1050.898672] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.898934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.898934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.899210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.899303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.899556] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.899671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.899728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.899876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.900043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.900156] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690e6efd-f18b-488b-b84c-5caae41cc733 is going to be created. [ 1050.965231] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.965231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.965427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.965666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.965854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.982386] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690e6efd-f18b-488b-b84c-5caae41cc733 in Status: IN_PROGRESS for 2s [ 1051.308775] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1051.308775] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1051.346524] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.346982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.347233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.349732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.349732] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.349732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.349732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.349732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.349732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.349732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.349732] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.852992] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.853360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.853360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.853570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.853729] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.853842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.853892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.854050] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.854136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.854223] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.854372] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.854464] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.854523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.854661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.854796] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.855304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.855421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.855725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.855846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.855963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.856241] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.866832] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1051.868042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.869059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.869847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.870369] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.870811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.870921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.871343] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.871474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.872175] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.872175] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.873266] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.874429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.874646] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.875209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.875209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.875426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.875836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.881251] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.361420] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f55a1eeb-30c3-44c5-bd92-57dad54e2585: rpc.has_security_group_logging(os_id): False [ 1052.379061] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.379273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.379273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.379492] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.379582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.380409] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.380409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.380409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.380409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.380409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.380409] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.380910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.380910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.380910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.380910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.380910] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.381179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.381179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.381179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.381273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.381311] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be updated. [ 1052.382545] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.382660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.382821] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.449399] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.449583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.449650] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.449891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.450055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.480495] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1052.888729] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.995986] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690e6efd-f18b-488b-b84c-5caae41cc733 in Status: SUCCESS [ 1052.996881] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.391647] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.394245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.394245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.394245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.394245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.394245] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1053.429584] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.429584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.429584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.429584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.429584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.439238] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1054.321976] env[68109]: INFO networking_nsxv3.common.synchronization [None req-2490ff3d-ea01-4387-a9e6-c4a94e2eca8d None None] Enqueued Resource ID: 1d26caa5-1194-481e-aac6-3fe5690b3cca with Priority: HIGHEST for action port [ 1054.321976] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d26caa5-1194-481e-aac6-3fe5690b3cca with Priority: HIGHEST for action port [ 1054.321976] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d26caa5-1194-481e-aac6-3fe5690b3cca taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.321976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d26caa5-1194-481e-aac6-3fe5690b3cca" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.321976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d26caa5-1194-481e-aac6-3fe5690b3cca" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.321976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d26caa5-1194-481e-aac6-3fe5690b3cca" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.324377] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d26caa5-1194-481e-aac6-3fe5690b3cca',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.508769] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1054.508769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.599164] env[68109]: INFO networking_nsxv3.common.synchronization [req-7d749a8e-2e4e-49f8-a80e-5d59bba9c174 req-60a0fbbd-4784-4019-8fcf-b832431991e4 tempest-ServerRescueNegativeTestJSON-575486598 tempest-ServerRescueNegativeTestJSON-575486598-project-member] Enqueued Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGHEST for action security_group_members [ 1054.599164] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGHEST for action security_group_members [ 1054.599164] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-747242aa-4753-441a-b06c-3f9a70ac6a6e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.599164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.599164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.599164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.599164] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.599164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.599164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.599164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.599164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.599164] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('747242aa-4753-441a-b06c-3f9a70ac6a6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.826799] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d26caa5-1194-481e-aac6-3fe5690b3cca [ 1054.826962] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.827169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.827227] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.827391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.827479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.827578] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d26caa5-1194-481e-aac6-3fe5690b3cca already deleted. [ 1054.827659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d26caa5-1194-481e-aac6-3fe5690b3cca" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.093128] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.093325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.093325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.093552] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.113938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.113990] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.114131] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.114237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.114415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.114503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.114642] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e is going to be updated. [ 1055.120014] env[68109]: INFO networking_nsxv3.common.synchronization [req-5854583c-94b9-4e0d-a7f5-1587901dc975 req-79f022a9-9cba-498e-8bfb-924b2819db88 tempest-ServersAdminTestJSON-278829923 tempest-ServersAdminTestJSON-278829923-project-member] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1055.121369] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1055.121807] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.121807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.122012] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.122207] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.122280] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.122372] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.122439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.122604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.122684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.122781] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.140114] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.140355] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.140355] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.140761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.140761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.151085] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e in Status: IN_PROGRESS for 2s [ 1055.449925] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1055.449925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.449925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.449925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.450353] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.450353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.450353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.450353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.450504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.450504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.450677] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.450759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.450795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.451090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.451090] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.451211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.451245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.451839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.451839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.451839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.451839] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.498629] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.498629] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.498629] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.498629] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.498629] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.498629] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.498629] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.498629] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.498629] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.498629] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1055.498629] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.498629] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.498629] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.499237] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1055.499237] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.499237] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1055.516617] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1055.516826] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1055.516976] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1055.517313] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.517638] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-4174a1ae-9615-4b5f-9003-2fb9aafed45d taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.517819] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-4174a1ae-9615-4b5f-9003-2fb9aafed45d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.517950] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-4174a1ae-9615-4b5f-9003-2fb9aafed45d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.518298] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-4174a1ae-9615-4b5f-9003-2fb9aafed45d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.518444] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4174a1ae-9615-4b5f-9003-2fb9aafed45d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.625443] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.958854] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dd7db8b-2c17-4640-bd53-bfb063c83711: rpc.has_security_group_logging(os_id): False [ 1055.976853] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.976983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.977062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.977274] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.977389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.977545] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.977637] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.977698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.977840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.977958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.978182] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.978278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.978336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.978476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.978545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.978726] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.978812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.978868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.979010] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.980245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.980245] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1056.022584] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.022809] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.023230] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.023230] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.023389] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.023629] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 4174a1ae-9615-4b5f-9003-2fb9aafed45d not found, creating... [ 1056.023929] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.024105] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.024214] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.025451] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.025451] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.025451] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.025451] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.027920] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.027920] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.027920] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.027920] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 4174a1ae-9615-4b5f-9003-2fb9aafed45d is going to be created. [ 1056.051440] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.051625] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.051810] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.052058] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.053174] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.053174] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-4174a1ae-9615-4b5f-9003-2fb9aafed45d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.054317] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.054317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.054317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.054477] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.054575] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.070211] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1056.130484] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.632128] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.632128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.632128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.632128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.632128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.632128] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be updated. [ 1056.661678] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.661678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.661678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.661678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.661678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.669272] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1056.843731] env[68109]: INFO networking_nsxv3.common.synchronization [None req-2a20e370-21ed-439e-9c9c-5bdad457542a None None] Enqueued Resource ID: 4e54c36f-6fd4-4d5a-b9d4-2ce49ad4e47b with Priority: HIGHEST for action port [ 1056.843731] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e54c36f-6fd4-4d5a-b9d4-2ce49ad4e47b with Priority: HIGHEST for action port [ 1056.843731] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e54c36f-6fd4-4d5a-b9d4-2ce49ad4e47b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.843731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e54c36f-6fd4-4d5a-b9d4-2ce49ad4e47b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.843731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e54c36f-6fd4-4d5a-b9d4-2ce49ad4e47b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.844241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e54c36f-6fd4-4d5a-b9d4-2ce49ad4e47b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.844445] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e54c36f-6fd4-4d5a-b9d4-2ce49ad4e47b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.161099] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e in Status: SUCCESS [ 1057.161302] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e deletion is rescheduled due to dependency. [ 1057.161420] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.290326] env[68109]: INFO networking_nsxv3.common.synchronization [req-5854583c-94b9-4e0d-a7f5-1587901dc975 req-78fc6338-ba49-4fe2-b724-66e0e99b8e9d service nova] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_rules [ 1057.290326] env[68109]: INFO networking_nsxv3.common.synchronization [req-5854583c-94b9-4e0d-a7f5-1587901dc975 req-78fc6338-ba49-4fe2-b724-66e0e99b8e9d service nova] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1057.290326] env[68109]: INFO networking_nsxv3.common.synchronization [req-5854583c-94b9-4e0d-a7f5-1587901dc975 req-78fc6338-ba49-4fe2-b724-66e0e99b8e9d service nova] Enqueued Resource ID: 4174a1ae-9615-4b5f-9003-2fb9aafed45d with Priority: HIGHEST for action port [ 1057.290326] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_rules [ 1057.290326] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1057.290326] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4174a1ae-9615-4b5f-9003-2fb9aafed45d with Priority: HIGHEST for action port [ 1057.292169] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.293019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.293178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.293385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.293571] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.294519] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.294658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.295012] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-4174a1ae-9615-4b5f-9003-2fb9aafed45d taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.295163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4174a1ae-9615-4b5f-9003-2fb9aafed45d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.295232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4174a1ae-9615-4b5f-9003-2fb9aafed45d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.295496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4174a1ae-9615-4b5f-9003-2fb9aafed45d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.295496] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4174a1ae-9615-4b5f-9003-2fb9aafed45d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.347301] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e54c36f-6fd4-4d5a-b9d4-2ce49ad4e47b [ 1057.347520] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.347721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.347789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.348044] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.348138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.348234] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e54c36f-6fd4-4d5a-b9d4-2ce49ad4e47b already deleted. [ 1057.348314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e54c36f-6fd4-4d5a-b9d4-2ce49ad4e47b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.597613] env[68109]: INFO networking_nsxv3.common.synchronization [None req-2c910e82-a4f5-4650-a38e-b8456cf3c599 None None] Enqueued Resource ID: 2bd6797e-3f16-451e-9589-48799e00f122 with Priority: HIGHEST for action port [ 1057.600148] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bd6797e-3f16-451e-9589-48799e00f122 with Priority: HIGHEST for action port [ 1057.600148] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bd6797e-3f16-451e-9589-48799e00f122 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.600148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bd6797e-3f16-451e-9589-48799e00f122" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.600148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bd6797e-3f16-451e-9589-48799e00f122" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.600148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bd6797e-3f16-451e-9589-48799e00f122" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.600148] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bd6797e-3f16-451e-9589-48799e00f122',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.797384] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.797732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.797732] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4174a1ae-9615-4b5f-9003-2fb9aafed45d with status ACTIVE [ 1057.797883] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.798037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.798219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.798310] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.798399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.798642] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.798710] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.798748] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.798885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.798937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.799133] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.799225] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.799908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.799908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.799908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.799908] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4174a1ae-9615-4b5f-9003-2fb9aafed45d is going to be updated. [ 1057.820421] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.820613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.820685] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.820918] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.821009] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.821167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4174a1ae-9615-4b5f-9003-2fb9aafed45d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.087196] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1058.087340] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.087598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.087912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.089215] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.104498] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bd6797e-3f16-451e-9589-48799e00f122 [ 1058.104883] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.104883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.105046] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.105187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.105282] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.105388] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bd6797e-3f16-451e-9589-48799e00f122 already deleted. [ 1058.105472] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bd6797e-3f16-451e-9589-48799e00f122" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.590933] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.591125] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.591208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.591415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.591649] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.591737] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.591778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.591961] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.592086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.592184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.592275] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.684074] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1058.684278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.684505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.684678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.684903] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.685047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.685047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.686130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.686130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.686130] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.096125] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.096427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.096427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.096595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.097186] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.098520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.098611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.098797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.098884] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.098979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.099158] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.099255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.099317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.099460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.099599] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.099690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.099751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.099885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.099959] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.100052] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.100145] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.187904] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.549401] env[68109]: INFO networking_nsxv3.common.synchronization [req-e6ac1ab7-34f9-491f-87d5-d5e62d3fe5d4 req-fd0bf5fc-07fa-4b23-8f7d-3a382f0ffb4f tempest-ServersTestMultiNic-1863331152 tempest-ServersTestMultiNic-1863331152-project-member] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1059.550424] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1059.550424] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.551392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.551392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.551392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.551392] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.551392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.551392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.551921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.551921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.551921] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.601911] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7dd7db8b-2c17-4640-bd53-bfb063c83711: rpc.has_security_group_logging(os_id): False [ 1059.627425] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.627562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.627770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.628841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.628841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.628841] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.628841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.629106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.629687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.629804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.630057] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.630187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.630325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.630447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.630549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.630774] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.630899] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.630981] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.631180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.631242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.631364] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1059.691676] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.693510] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.693684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.693754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.694048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.698561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.717617] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1059.769996] env[68109]: INFO networking_nsxv3.common.synchronization [req-e6ac1ab7-34f9-491f-87d5-d5e62d3fe5d4 req-4c147672-74af-491b-b600-a8b28bbde17f tempest-ServersTestMultiNic-1863331152 tempest-ServersTestMultiNic-1863331152-project-member] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1059.770867] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGHEST for action security_group_members [ 1059.771877] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.771877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.936931] env[68109]: INFO networking_nsxv3.common.synchronization [None req-44ff14c8-b711-46c5-bf29-131a11aa348e None None] Enqueued Resource ID: 6666242a-c403-46b4-9e49-e6a9ed70b550 with Priority: HIGHEST for action port [ 1059.937108] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6666242a-c403-46b4-9e49-e6a9ed70b550 with Priority: HIGHEST for action port [ 1059.938157] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-6666242a-c403-46b4-9e49-e6a9ed70b550 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.938157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6666242a-c403-46b4-9e49-e6a9ed70b550" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.938157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6666242a-c403-46b4-9e49-e6a9ed70b550" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.938157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6666242a-c403-46b4-9e49-e6a9ed70b550" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.938372] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6666242a-c403-46b4-9e49-e6a9ed70b550',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.054482] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.202260] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.202260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.202609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.202609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.202676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.202733] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be updated. [ 1060.230347] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.231289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.231289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.231370] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.231500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.240506] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1060.441084] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6666242a-c403-46b4-9e49-e6a9ed70b550 [ 1060.441084] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.441276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.441276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.441500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.441590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.441696] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6666242a-c403-46b4-9e49-e6a9ed70b550 already deleted. [ 1060.441772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6666242a-c403-46b4-9e49-e6a9ed70b550" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.558224] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.060912] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.061082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.062782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.062782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.062782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.062782] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1061.088556] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.088704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.088751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.088960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.089124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.096531] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1061.486785] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.487160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.487160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.487302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.487414] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.588796] env[68109]: INFO networking_nsxv3.common.synchronization [req-c79377a1-2498-462d-b0e9-a80fdef322a0 req-8f2a9b9f-2adf-49b5-9300-68acb9f0e11b tempest-ImagesOneServerNegativeTestJSON-1955885897 tempest-ImagesOneServerNegativeTestJSON-1955885897-project-member] Enqueued Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1061.589362] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1061.589689] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.589812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.589879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.590563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.590729] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.590837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.590937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.591128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.591249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.591307] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.734714] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1061.734956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.989704] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.991810] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-137 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.992016] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-137" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.992151] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-137" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.992472] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-137" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.992725] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.992895] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.993028] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.993253] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.993401] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.993610] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1061.993743] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1061.993857] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1061.993971] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1061.994133] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1061.994282] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1061.994434] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1062.013113] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1062.013291] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1062.013429] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1062.013609] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-137" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.013927] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-a95f0cc5-8919-402d-8944-f79b25224c66 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.014118] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-a95f0cc5-8919-402d-8944-f79b25224c66" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.014239] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-a95f0cc5-8919-402d-8944-f79b25224c66" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.014553] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-a95f0cc5-8919-402d-8944-f79b25224c66" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.014697] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a95f0cc5-8919-402d-8944-f79b25224c66',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.095200] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.095200] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.095200] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.095351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.095351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.095502] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.095638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.095738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.095900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.096039] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.096105] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab already deleted. [ 1062.096188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.249037] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1062.249475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.249475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.249630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.249842] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.249992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.250077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.250256] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.250344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.250416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.250531] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.496155] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.518891] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.519277] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.519277] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.519581] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.519742] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.519922] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port a95f0cc5-8919-402d-8944-f79b25224c66 not found, creating... [ 1062.520214] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.520381] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.520503] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.520730] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.520887] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.521209] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.521398] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.521656] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.521912] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.522143] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.522226] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: a95f0cc5-8919-402d-8944-f79b25224c66 is going to be created. [ 1062.542606] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.542839] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.542975] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.543293] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.543529] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.543860] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-a95f0cc5-8919-402d-8944-f79b25224c66" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.752375] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.752627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.752715] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.752948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.753172] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.753283] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.753349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.753521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.753610] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.753735] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.753928] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.754072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.754140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.754302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.754443] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.754537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.754595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.754733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.754813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.754897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.754989] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.999123] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1062.999249] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1063.107185] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1063.107491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.107693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.107884] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.108112] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.108237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.108304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.108481] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.108580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.108633] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.257567] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f55a1eeb-30c3-44c5-bd92-57dad54e2585: rpc.has_security_group_logging(os_id): False [ 1063.285207] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.285389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.285434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.285641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.285779] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.286055] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.286167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.286243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.286426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.286516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.286748] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.286903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.286962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.287227] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.287313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.287572] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.287772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.287772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.287926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.288076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.288208] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be updated. [ 1063.356301] env[68109]: INFO networking_nsxv3.common.synchronization [req-c79377a1-2498-462d-b0e9-a80fdef322a0 req-bd35c85f-047b-44c7-aefc-e87e3549c827 service nova] Enqueued Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_rules [ 1063.356301] env[68109]: INFO networking_nsxv3.common.synchronization [req-c79377a1-2498-462d-b0e9-a80fdef322a0 req-bd35c85f-047b-44c7-aefc-e87e3549c827 service nova] Enqueued Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1063.356301] env[68109]: INFO networking_nsxv3.common.synchronization [req-c79377a1-2498-462d-b0e9-a80fdef322a0 req-bd35c85f-047b-44c7-aefc-e87e3549c827 service nova] Enqueued Resource ID: a95f0cc5-8919-402d-8944-f79b25224c66 with Priority: HIGHEST for action port [ 1063.356301] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.356301] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.356796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.357156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.357402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.359148] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_rules [ 1063.359390] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1063.359589] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a95f0cc5-8919-402d-8944-f79b25224c66 with Priority: HIGHEST for action port [ 1063.360086] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.360400] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.360560] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.360867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.361057] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.362317] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.363561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.363561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.363561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.363561] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.363561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.363561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.363561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.363561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.363561] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.364801] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-a95f0cc5-8919-402d-8944-f79b25224c66 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.364801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a95f0cc5-8919-402d-8944-f79b25224c66" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.364801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a95f0cc5-8919-402d-8944-f79b25224c66" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.364801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a95f0cc5-8919-402d-8944-f79b25224c66" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.364801] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a95f0cc5-8919-402d-8944-f79b25224c66',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.381069] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1063.611328] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.611695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.611695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.611695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.611797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.612230] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.612230] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.612230] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.612500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.612500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.612500] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be updated. [ 1063.671175] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.671342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.671385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.671593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.671797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.685136] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: IN_PROGRESS for 2s [ 1063.867029] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.868244] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.868380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.868549] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a95f0cc5-8919-402d-8944-f79b25224c66 with status ACTIVE [ 1063.868749] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.868870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.868949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.869208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.869323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.869522] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.869635] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.869709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.869883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.869981] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.870204] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.870311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.870383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.870552] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.870676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.870772] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a95f0cc5-8919-402d-8944-f79b25224c66 is going to be updated. [ 1063.875146] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.875275] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.875361] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.875599] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.887827] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1063.889077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.890477] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1063.892591] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.892705] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.892781] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.892979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.893113] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.893260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a95f0cc5-8919-402d-8944-f79b25224c66" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.016577] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.018029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.018029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.018029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.027034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.027531] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1064.027616] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.027711] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1064.067050] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.067216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.067277] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.067492] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.069055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.069246] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1064.094626] env[68109]: INFO networking_nsxv3.common.synchronization [req-b4feb131-02ac-4a1b-8484-fddeb6e0f041 req-bd0275ee-1e12-4b4b-8fbc-0a74e5d3e886 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_members [ 1064.095159] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_members [ 1064.095463] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e6efd-f18b-488b-b84c-5caae41cc733 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.095584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.095650] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.095910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.096182] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.096182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.096307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.096355] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.096439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.096526] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.163470] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.163824] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.163824] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.163931] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.164206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.164457] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1064.230856] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.231034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.231123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.231284] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.231541] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.231799] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1064.231894] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'9e88ca4b-470a-485c-b906-6c8d635109cb', '3bd26aad-19e8-435d-b39a-5875f3b5cfd7', 'ea631704-7b9c-465d-b911-2ef8b25de4cb', 'f55a1eeb-30c3-44c5-bd92-57dad54e2585', '747242aa-4753-441a-b06c-3f9a70ac6a6e', '1c79bef7-bf07-4509-8ec1-1db749783b03', '4ea34252-af52-4a69-b365-67afcde4765d', '50bf3a02-de03-46e5-a1de-389d8f706b9b', '7188635c-e1c3-4fba-9e1d-f639d22a02e3', '15c24162-8d2d-427e-9b29-f175f91a92c1', '3bcda49a-0e74-4618-bd35-62ff5440bd3b', '841d58e8-0316-41e3-a855-66ac66e6d9f4', '1589ee36-8ec7-4a35-a6c9-857230faca44', 'd90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac', '128e84ba-79f2-427a-b1a9-229985255d74', 'cbc22896-640c-4f05-bfd9-6290e8092bb2', '2f5de880-5f98-48cf-ba2c-fdf857770d6a', '14fbc65b-2397-4f06-bab2-162f42e5d290', 'f7eff74c-b690-47ef-ba84-9ec9d2765c99', 'e79c46e7-8141-49ae-9d8a-e8124ebeb86c', '690e6efd-f18b-488b-b84c-5caae41cc733', '817904c7-035a-41ce-bf21-c0db158c7bea', '7573caa0-9f71-40fd-82c3-03fa2ce88dbf', 'e812d957-e1ec-4f99-86c2-485e7c16988a', '835f674b-2b51-49ea-acd5-6a176ad00616', 'd063caf8-0f34-48a0-8035-c8a07c90a01c', '256c7a06-cd22-48f9-a904-ae2dd6fec0e8', '327a22ab-0003-41d7-851d-6eba37a2b9dc', '3b323145-eb80-4cd0-b113-05cefe5e7b4c', '7dd7db8b-2c17-4640-bd53-bfb063c83711', '9353334a-e1b0-43d9-9c87-a08b8516326e', 'f76ac522-d413-411a-995f-1682c0fc160f', 'ee121dc7-4686-4564-b58a-255456cf3857', '80fea482-6d64-4937-892c-62371db01817', '3775fbff-3109-41e9-a7b4-71b12133d9f0', '04d6d7e9-ac4d-4788-ab37-9ef94a13367a', 'cd411cb2-c40e-46e4-a754-136e1fddced1', '115f89cb-8059-4b36-912a-10de0703affe', 'd2db7fe9-82f8-4d20-b269-363d052050b8', '2a8ad551-9243-4b5e-a0bd-acf823c5b01f', '367414dc-5bb3-4cf0-b02d-c624234144c1', '0f244466-a6a8-4118-96a9-bf22e5d33c96', 'fe094fad-6ec3-4179-88a0-da40e49c0ff5', 'a1b52ab9-23fb-4785-af13-8d3e64d2b62f', '02bc3e4c-0cd7-46a0-8516-a78e344aa1a0'} {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.232023] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1064.249702] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.249883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.249976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.250228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.250343] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.250417] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1064.250488] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.250559] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1064.320130] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.320322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.320391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.320604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.325023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.325023] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1064.325023] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.325023] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1064.325023] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1064.325023] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e88ca4b-470a-485c-b906-6c8d635109cb with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ea631704-7b9c-465d-b911-2ef8b25de4cb with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ea34252-af52-4a69-b365-67afcde4765d with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 128e84ba-79f2-427a-b1a9-229985255d74 with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c with Priority: HIGH for action security_group_rules [ 1064.325023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.373175] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.472092] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.472338] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.472496] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.472862] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.473278] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.473547] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.473726] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.473984] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.474188] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.474397] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.474533] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.474651] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.474761] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.474899] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.475018] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.475184] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.493914] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.494100] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1064.494245] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.494425] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.494734] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-f37625b5-3c70-4e58-ac49-a37b1b21ffc8 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.494906] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-f37625b5-3c70-4e58-ac49-a37b1b21ffc8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.495038] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-f37625b5-3c70-4e58-ac49-a37b1b21ffc8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.495363] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-f37625b5-3c70-4e58-ac49-a37b1b21ffc8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.495504] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f37625b5-3c70-4e58-ac49-a37b1b21ffc8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.626033] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.876303] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.876453] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.876526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.876745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.876839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.876958] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab is going to be created. [ 1064.900066] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.900066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.900066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.900066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.900066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.908150] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: UNINITIALIZED for 2s [ 1064.997636] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.997864] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.997999] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.998323] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.998521] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.998704] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port f37625b5-3c70-4e58-ac49-a37b1b21ffc8 not found, creating... [ 1064.998977] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.999226] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.999374] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.999603] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.999747] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.000042] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.000206] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.000332] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.000539] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.000677] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.000818] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: f37625b5-3c70-4e58-ac49-a37b1b21ffc8 is going to be created. [ 1065.020643] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.021391] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.021391] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.021391] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.021514] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.022347] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-f37625b5-3c70-4e58-ac49-a37b1b21ffc8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.101557] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.395921] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1065.396160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.604211] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.604389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.604462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.604685] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.604777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.604878] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e6efd-f18b-488b-b84c-5caae41cc733 is going to be updated. [ 1065.634908] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.634908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.634908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.634908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.634908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.643181] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e6efd-f18b-488b-b84c-5caae41cc733 in Status: IN_PROGRESS for 2s [ 1065.695501] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 in Status: SUCCESS [ 1065.695705] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 deletion is rescheduled due to dependency. [ 1065.695858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.836022] env[68109]: INFO networking_nsxv3.common.synchronization [req-b4feb131-02ac-4a1b-8484-fddeb6e0f041 req-2f91582e-7f0e-4400-95f4-78a50c8b5677 service nova] Enqueued Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_rules [ 1065.836022] env[68109]: INFO networking_nsxv3.common.synchronization [req-b4feb131-02ac-4a1b-8484-fddeb6e0f041 req-2f91582e-7f0e-4400-95f4-78a50c8b5677 service nova] Enqueued Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_members [ 1065.836022] env[68109]: INFO networking_nsxv3.common.synchronization [req-b4feb131-02ac-4a1b-8484-fddeb6e0f041 req-2f91582e-7f0e-4400-95f4-78a50c8b5677 service nova] Enqueued Resource ID: f37625b5-3c70-4e58-ac49-a37b1b21ffc8 with Priority: HIGHEST for action port [ 1065.836022] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_rules [ 1065.836022] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_members [ 1065.836022] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37625b5-3c70-4e58-ac49-a37b1b21ffc8 with Priority: HIGHEST for action port [ 1065.836472] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e88ca4b-470a-485c-b906-6c8d635109cb with Priority: HIGH for action security_group_rules [ 1065.836722] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea631704-7b9c-465d-b911-2ef8b25de4cb with Priority: HIGH for action security_group_rules [ 1065.836886] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea34252-af52-4a69-b365-67afcde4765d with Priority: HIGH for action security_group_rules [ 1065.837614] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 128e84ba-79f2-427a-b1a9-229985255d74 with Priority: HIGH for action security_group_rules [ 1065.837850] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c with Priority: HIGH for action security_group_rules [ 1065.838064] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 with Priority: HIGH for action security_group_rules [ 1065.838264] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 with Priority: HIGH for action security_group_rules [ 1065.838951] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a with Priority: HIGH for action security_group_rules [ 1065.839199] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac with Priority: HIGH for action security_group_rules [ 1065.839389] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 with Priority: HIGH for action security_group_rules [ 1065.839632] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 with Priority: HIGH for action security_group_rules [ 1065.839810] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGH for action security_group_rules [ 1065.839987] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGH for action security_group_rules [ 1065.840194] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 with Priority: HIGH for action security_group_rules [ 1065.841015] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGH for action security_group_rules [ 1065.841015] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGH for action security_group_rules [ 1065.841015] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b with Priority: HIGH for action security_group_rules [ 1065.841015] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e with Priority: HIGH for action security_group_rules [ 1065.841015] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 with Priority: HIGH for action security_group_rules [ 1065.841015] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGH for action security_group_rules [ 1065.841386] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690e6efd-f18b-488b-b84c-5caae41cc733 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.841628] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.841767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.842070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.842231] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.843249] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e6efd-f18b-488b-b84c-5caae41cc733 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.845020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.845020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f37625b5-3c70-4e58-ac49-a37b1b21ffc8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.845020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f37625b5-3c70-4e58-ac49-a37b1b21ffc8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.845020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f37625b5-3c70-4e58-ac49-a37b1b21ffc8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.845020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f37625b5-3c70-4e58-ac49-a37b1b21ffc8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.845020] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f37625b5-3c70-4e58-ac49-a37b1b21ffc8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.845020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e88ca4b-470a-485c-b906-6c8d635109cb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.847587] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.847587] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.847587] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.847587] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e88ca4b-470a-485c-b906-6c8d635109cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.847587] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea631704-7b9c-465d-b911-2ef8b25de4cb taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.847587] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.847587] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.847587] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.847587] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea631704-7b9c-465d-b911-2ef8b25de4cb',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.848632] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ea34252-af52-4a69-b365-67afcde4765d taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.848919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.850038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.850038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.850038] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ea34252-af52-4a69-b365-67afcde4765d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.850420] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-128e84ba-79f2-427a-b1a9-229985255d74 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.850647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.850785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.851031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.851179] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('128e84ba-79f2-427a-b1a9-229985255d74',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.852081] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e79c46e7-8141-49ae-9d8a-e8124ebeb86c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.852377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.853042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.853301] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.853474] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e79c46e7-8141-49ae-9d8a-e8124ebeb86c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.854388] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.854627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.855356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.855633] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.855900] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7eff74c-b690-47ef-ba84-9ec9d2765c99',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.856823] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14fbc65b-2397-4f06-bab2-162f42e5d290 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.857075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.857234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.857466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.857613] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14fbc65b-2397-4f06-bab2-162f42e5d290',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.859019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.859019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.859019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.859019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.859019] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f5de880-5f98-48cf-ba2c-fdf857770d6a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.863122] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.863122] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.863122] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.863122] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.863122] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.863342] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbc22896-640c-4f05-bfd9-6290e8092bb2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.863538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.863674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.863893] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.864061] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbc22896-640c-4f05-bfd9-6290e8092bb2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.864787] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1589ee36-8ec7-4a35-a6c9-857230faca44 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.865021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.865210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.865620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.865829] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1589ee36-8ec7-4a35-a6c9-857230faca44',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.866679] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.866995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.867177] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.867584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.867760] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.868700] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.869529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.869529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.869529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.869529] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.870530] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15c24162-8d2d-427e-9b29-f175f91a92c1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.870766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.871738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.871738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.871738] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15c24162-8d2d-427e-9b29-f175f91a92c1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.872129] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.872334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.872461] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.872755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.872904] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.873800] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.874026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.876017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.876017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.876017] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.876017] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50bf3a02-de03-46e5-a1de-389d8f706b9b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.876017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.876017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.876017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.876017] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50bf3a02-de03-46e5-a1de-389d8f706b9b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.876657] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-747242aa-4753-441a-b06c-3f9a70ac6a6e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.876957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.877117] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.877365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.877580] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('747242aa-4753-441a-b06c-3f9a70ac6a6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.878457] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.878715] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.878956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.880727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.880727] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bd26aad-19e8-435d-b39a-5875f3b5cfd7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.880727] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.880727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.880727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.880727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.880727] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.917113] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.917256] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.917327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.917529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.919489] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.919673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.920410] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.920577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.922631] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.922785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.923582] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.923764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.924776] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.924930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.934325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.934549] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac is going to be deleted. [ 1065.935581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.935885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.950823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.950965] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 128e84ba-79f2-427a-b1a9-229985255d74 is going to be deleted. [ 1065.951840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.952061] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.967402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.967643] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea631704-7b9c-465d-b911-2ef8b25de4cb is going to be deleted. [ 1065.968764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.969061] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.987756] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.987943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.996197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.996366] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bd26aad-19e8-435d-b39a-5875f3b5cfd7 is going to be deleted. [ 1065.997454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.997704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.999351] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.999492] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.025496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.025496] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14fbc65b-2397-4f06-bab2-162f42e5d290 is going to be deleted. [ 1066.026357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.026634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.029972] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.030168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.063253] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.063383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.071292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.071420] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7eff74c-b690-47ef-ba84-9ec9d2765c99 is going to be deleted. [ 1066.072437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.072670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.072767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.072897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d90d4c7a-9c9c-46e4-a8fe-da7ecb8e06ac" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.073074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.073242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.073328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.073479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-128e84ba-79f2-427a-b1a9-229985255d74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.074107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.074403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.074549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.074674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea631704-7b9c-465d-b911-2ef8b25de4cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.075302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.075471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.075556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.075677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bd26aad-19e8-435d-b39a-5875f3b5cfd7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.118840] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.118986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.119064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.119292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.119677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.119677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14fbc65b-2397-4f06-bab2-162f42e5d290" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.167977] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.168173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.168209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.168458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.168516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.168637] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7eff74c-b690-47ef-ba84-9ec9d2765c99" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.386089] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e6efd-f18b-488b-b84c-5caae41cc733 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.386089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.386260] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f37625b5-3c70-4e58-ac49-a37b1b21ffc8 with status ACTIVE [ 1066.386424] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.386578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.386673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.386894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.386976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.387156] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.387250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.387310] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.387462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.387536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.387712] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.387833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.387895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.388046] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.388256] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.388382] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f37625b5-3c70-4e58-ac49-a37b1b21ffc8 is going to be updated. [ 1066.390769] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.390769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.390921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.391184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.391184] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.391418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.391488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.391773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.391892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.391985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.392090] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.393989] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.394232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.394316] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.394480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.394628] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.396805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.396805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.396805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.396805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.396805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.396805] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.396805] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.396805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.396805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.396805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.397295] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.397295] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.397295] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.397295] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.397295] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.397434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.397434] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.405329] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.405454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.405505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.405697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.405870] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.405965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.406035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.406200] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.406255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.406497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.406613] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.425363] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.425514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.425594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.425912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.427738] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.427861] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.432377] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.432377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.433588] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.433588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.434280] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.435032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.449426] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.449426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.449735] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.449830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.452136] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.452136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.452136] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.452136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.453363] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.453363] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.453941] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.453941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.454098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.454240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.454470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.454550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f37625b5-3c70-4e58-ac49-a37b1b21ffc8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.455348] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1066.455744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.455879] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e79c46e7-8141-49ae-9d8a-e8124ebeb86c is going to be deleted. [ 1066.456815] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.457030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.472544] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.472694] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ea34252-af52-4a69-b365-67afcde4765d is going to be deleted. [ 1066.473686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.473967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.502569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.502767] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbc22896-640c-4f05-bfd9-6290e8092bb2 is going to be deleted. [ 1066.504033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.504332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.532571] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.536320] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.537683] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.537787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.544364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.544693] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 747242aa-4753-441a-b06c-3f9a70ac6a6e is going to be deleted. [ 1066.545434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.545690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.568556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.568556] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f5de880-5f98-48cf-ba2c-fdf857770d6a is going to be deleted. [ 1066.568556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.568840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.572166] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.572311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.598893] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.599218] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15c24162-8d2d-427e-9b29-f175f91a92c1 is going to be deleted. [ 1066.600466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.600466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.614518] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.614864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.639305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.640791] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50bf3a02-de03-46e5-a1de-389d8f706b9b is going to be deleted. [ 1066.640791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.640791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.671503] env[68109]: INFO networking_nsxv3.common.synchronization [req-8dd28b1d-fc07-4877-a9a0-11e5f715ddec req-ef6fcb4e-0d21-4b50-b9fd-62568b88ef55 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_members [ 1066.673357] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_members [ 1066.675017] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.675017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.675017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.675017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.675017] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.675017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.675017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.675017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.675017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.675017] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.718295] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.718446] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.731949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.732949] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1589ee36-8ec7-4a35-a6c9-857230faca44 is going to be deleted. [ 1066.733344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.733619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.812186] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.812317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.813639] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.814075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.814268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.814381] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e88ca4b-470a-485c-b906-6c8d635109cb is going to be deleted. [ 1066.815407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.815621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.893110] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.893338] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b is going to be deleted. [ 1066.894818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.895286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.895451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.895601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ea34252-af52-4a69-b365-67afcde4765d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.895768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.896126] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.896227] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.896356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e79c46e7-8141-49ae-9d8a-e8124ebeb86c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.897483] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.897652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.897746] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.897973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.898175] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.898303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.898368] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.898550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.898787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.898787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.898935] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.899066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.899219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.899335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.899503] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.899626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.899707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.899865] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.899948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.900126] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.900250] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.901188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.901404] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.901513] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.901669] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbc22896-640c-4f05-bfd9-6290e8092bb2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.902045] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.903292] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.904323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.904665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.904781] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.904936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-747242aa-4753-441a-b06c-3f9a70ac6a6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.906065] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.906190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.906247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.906464] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.906556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.906697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1589ee36-8ec7-4a35-a6c9-857230faca44" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.907382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.907569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.907679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.907800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f5de880-5f98-48cf-ba2c-fdf857770d6a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.907963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.908164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.908270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.908389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15c24162-8d2d-427e-9b29-f175f91a92c1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.908546] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.908726] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.908848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.908991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50bf3a02-de03-46e5-a1de-389d8f706b9b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.916065] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.916254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.916309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.916558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.916729] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.916838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.916885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.917058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.917151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.917239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.917393] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.917496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.917545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.917674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.917837] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.917906] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.917947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.918323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.918411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.918497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.918590] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.925158] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: SUCCESS [ 1066.925492] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.927512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.927927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.928245] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.928457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.928561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.928821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.928972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.929157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.929312] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.970869] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.972577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.972577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.972577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.972577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.972577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e88ca4b-470a-485c-b906-6c8d635109cb" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.009781] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.012399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.012399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.012399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.012399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.012399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.051331] env[68109]: INFO networking_nsxv3.common.synchronization [req-4258e820-ced2-4843-8b00-d4b940c08986 req-569d280b-9b5b-4b3e-9d01-450f14c80e50 tempest-ServerRescueNegativeTestJSON-575486598 tempest-ServerRescueNegativeTestJSON-575486598-project-member] Enqueued Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_members [ 1067.051331] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_members [ 1067.051331] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.051331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.051331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.051331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.051331] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.051331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.051331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.052122] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.052326] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.052526] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.179040] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.179218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.179218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.179415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.207436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.207436] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.207436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.207436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.207436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.207436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.207436] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c is going to be updated. [ 1067.236175] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.236175] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.236175] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.236175] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.236175] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.247081] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c in Status: IN_PROGRESS for 2s [ 1067.407443] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c79bef7-bf07-4509-8ec1-1db749783b03: rpc.has_security_group_logging(os_id): False [ 1067.408706] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7188635c-e1c3-4fba-9e1d-f639d22a02e3: rpc.has_security_group_logging(os_id): False [ 1067.409458] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 841d58e8-0316-41e3-a855-66ac66e6d9f4: rpc.has_security_group_logging(os_id): False [ 1067.421417] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f55a1eeb-30c3-44c5-bd92-57dad54e2585: rpc.has_security_group_logging(os_id): False [ 1067.426830] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.427051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.427167] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.427686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.429881] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.430045] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.431422] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.431558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.433504] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.433504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.433504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.433504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.433504] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.433504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.433504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.433504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.433504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.433504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.433905] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.433905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.433905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.434090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.434306] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.434453] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.434551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.434766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.434890] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.435041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.435184] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.439163] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.440037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.445028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.445316] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.445437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.445503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.445854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.445854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.446029] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.446134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.446196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.446373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.446449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.446640] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.446720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.446784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.446957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.447048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.447140] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 is going to be updated. [ 1067.448240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.448363] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.470021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.470021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.470021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.470021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.470021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.470021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.470021] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 is going to be updated. [ 1067.470021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.470021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.487307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.487591] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.487717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.487786] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.487991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.488115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.488335] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.488440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.488505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.488659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.488734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.488917] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.488998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.489076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.489253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.489305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.489368] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be updated. [ 1067.490747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.490941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.509530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.510039] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.510239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.510347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.510644] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.510782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.510930] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be updated. [ 1067.524203] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.524377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.524475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.524700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.524875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.531848] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.532014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.532014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.532353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.532523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.538341] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: IN_PROGRESS for 2s [ 1067.541517] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: IN_PROGRESS for 2s [ 1067.551828] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.551963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.552043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.552246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.552386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.554928] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.565159] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1067.575470] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.575470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.575470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.575470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.575659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.607715] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: IN_PROGRESS for 2s [ 1067.658125] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e6efd-f18b-488b-b84c-5caae41cc733 in Status: SUCCESS [ 1067.658720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.658720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.658806] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.659106] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.659259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.659384] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.659577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.659664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.659760] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.938125] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 530264c4-f8bd-43b3-94f9-812deb7104ab: rpc.has_security_group_logging(os_id): False [ 1067.959160] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.959350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.959473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.959653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.959795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.960041] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.960201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.960274] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.960499] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.960631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.960876] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.961024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.961098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.961270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.961392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.961664] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.961842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.961883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.962029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.962119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.962229] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab is going to be created. [ 1068.020654] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.020654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.020654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.020654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.020654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.030545] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: IN_PROGRESS for 2s [ 1068.057295] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.161806] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.561512] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.561685] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.561756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.561983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.563089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.563089] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 is going to be updated. [ 1068.588912] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.589109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.589201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.589449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.589630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.597616] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: IN_PROGRESS for 2s [ 1068.664196] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.820874] env[68109]: INFO networking_nsxv3.common.synchronization [req-3a82bfd8-4675-4d13-9b9f-b6201ce35ab6 req-8bb07020-7e6a-4e56-a05b-6490ecb0dd58 tempest-ServerRescueTestJSON-1286138287 tempest-ServerRescueTestJSON-1286138287-project-member] Enqueued Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_members [ 1068.821460] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_members [ 1068.821763] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.825517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.825598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.825928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.826985] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.826985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.826985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.826985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.826985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.826985] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.108588] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-996 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.108790] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-996" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.108914] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-996" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.109310] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-996" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.109614] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.109812] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.109940] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.110230] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.110391] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.110622] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.110763] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.110881] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.111039] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.111172] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.111286] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.111492] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.129668] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.129997] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1069.130108] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.130326] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-996" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.130651] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-0b20763f-7518-40d6-939b-75268d412b8c taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.130925] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-0b20763f-7518-40d6-939b-75268d412b8c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.130960] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-0b20763f-7518-40d6-939b-75268d412b8c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.131316] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-0b20763f-7518-40d6-939b-75268d412b8c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.131463] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b20763f-7518-40d6-939b-75268d412b8c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.166586] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.166756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.166756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.167027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.167148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.167264] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e6efd-f18b-488b-b84c-5caae41cc733 is going to be updated. [ 1069.196080] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.196248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.196322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.196535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.196680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.212165] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e6efd-f18b-488b-b84c-5caae41cc733 in Status: IN_PROGRESS for 2s [ 1069.256026] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c in Status: SUCCESS [ 1069.256240] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c deletion is rescheduled due to dependency. [ 1069.256340] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.328455] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.328682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.328682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.328921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.329030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.329225] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.329362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.329409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.329528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.329607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.329682] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a565832-732a-4ead-8829-a1e204cdbc42 already deleted. [ 1069.329760] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.551115] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: SUCCESS [ 1069.551363] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.552133] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: SUCCESS [ 1069.552308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.578015] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1069.578335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.618189] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 1069.618533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.633873] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.634155] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.634290] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.634574] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.634722] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.634910] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 0b20763f-7518-40d6-939b-75268d412b8c not found, creating... [ 1069.635222] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.635384] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.635508] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.635961] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.635961] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.636312] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.636529] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.636614] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.636884] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.636982] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.637146] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 0b20763f-7518-40d6-939b-75268d412b8c is going to be created. [ 1069.667175] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.667519] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.667588] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.667861] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.668124] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.668366] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-0b20763f-7518-40d6-939b-75268d412b8c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.043261] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: SUCCESS [ 1070.043518] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.372362] env[68109]: INFO networking_nsxv3.common.synchronization [req-3a82bfd8-4675-4d13-9b9f-b6201ce35ab6 req-3bf56489-e1ac-4746-8427-c22518258960 service nova] Enqueued Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_rules [ 1070.372543] env[68109]: INFO networking_nsxv3.common.synchronization [req-3a82bfd8-4675-4d13-9b9f-b6201ce35ab6 req-3bf56489-e1ac-4746-8427-c22518258960 service nova] Enqueued Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_members [ 1070.372691] env[68109]: INFO networking_nsxv3.common.synchronization [req-3a82bfd8-4675-4d13-9b9f-b6201ce35ab6 req-3bf56489-e1ac-4746-8427-c22518258960 service nova] Enqueued Resource ID: 0b20763f-7518-40d6-939b-75268d412b8c with Priority: HIGHEST for action port [ 1070.372922] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_rules [ 1070.373062] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_members [ 1070.373163] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b20763f-7518-40d6-939b-75268d412b8c with Priority: HIGHEST for action port [ 1070.373690] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.373851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.373904] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.374162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.374247] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.375223] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.375346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.375591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.375591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.375758] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.375821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.375922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.376078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.376161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.376247] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.378364] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b20763f-7518-40d6-939b-75268d412b8c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.378364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b20763f-7518-40d6-939b-75268d412b8c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.378364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b20763f-7518-40d6-939b-75268d412b8c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.378364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b20763f-7518-40d6-939b-75268d412b8c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.378364] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b20763f-7518-40d6-939b-75268d412b8c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.607261] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: IN_PROGRESS for 4s [ 1070.880612] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.880903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.881087] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.882061] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b20763f-7518-40d6-939b-75268d412b8c with status ACTIVE [ 1070.882292] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.882436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.882517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.882755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.882882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.883091] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.883215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.883315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.883459] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.883540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.883772] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.883896] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.883985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.884533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.884687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.885111] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b20763f-7518-40d6-939b-75268d412b8c is going to be updated. [ 1070.908128] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.908350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.908447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.908850] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.909519] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.909789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b20763f-7518-40d6-939b-75268d412b8c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.221915] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e6efd-f18b-488b-b84c-5caae41cc733 in Status: SUCCESS [ 1071.222728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.222728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.222728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.222902] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.222902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.222994] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.223134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.223216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.223302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.223393] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.387632] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.725438] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.889428] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.889793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.889793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.889854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.889943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.890057] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a565832-732a-4ead-8829-a1e204cdbc42 is going to be created. [ 1071.919029] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.919199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.919253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.919486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.919642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.927729] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a565832-732a-4ead-8829-a1e204cdbc42 in Status: UNINITIALIZED for 2s [ 1072.227240] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 690e6efd-f18b-488b-b84c-5caae41cc733: rpc.has_security_group_logging(os_id): False [ 1072.250051] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.250245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.250301] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.250482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.274308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.274655] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.274786] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.274854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.275080] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.275172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.275265] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690e6efd-f18b-488b-b84c-5caae41cc733 is going to be updated. [ 1072.348602] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.349389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.349389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.349389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.349389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.365136] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690e6efd-f18b-488b-b84c-5caae41cc733 in Status: IN_PROGRESS for 2s [ 1072.617738] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: SUCCESS [ 1072.617738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.936500] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a565832-732a-4ead-8829-a1e204cdbc42 in Status: SUCCESS [ 1073.936748] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.936920] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.937154] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.937353] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.937472] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.937538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.937690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.937768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.937854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.937946] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.378417] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 690e6efd-f18b-488b-b84c-5caae41cc733 in Status: SUCCESS [ 1074.378417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.443023] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.443023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.443023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.443023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.443023] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.443023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.443023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.443023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.443023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.443023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.443023] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.443023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.443023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.443023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.443023] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.443023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.443714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.443714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.443714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.443953] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.444178] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.631706] env[68109]: INFO networking_nsxv3.common.synchronization [req-4bdce4d0-9c38-4fd8-8e1d-3f02b18e8c32 req-05fa2868-fc3a-4d12-89f8-20a51ab87971 tempest-AttachInterfacesUnderV243Test-1101867593 tempest-AttachInterfacesUnderV243Test-1101867593-project-member] Enqueued Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_members [ 1074.632447] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_members [ 1074.632784] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd411cb2-c40e-46e4-a754-136e1fddced1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.632908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.633114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.634308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.634308] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.634308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.634308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.634308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.634308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.634308] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.666150] env[68109]: INFO networking_nsxv3.common.synchronization [req-4bdce4d0-9c38-4fd8-8e1d-3f02b18e8c32 req-05fa2868-fc3a-4d12-89f8-20a51ab87971 tempest-AttachInterfacesUnderV243Test-1101867593 tempest-AttachInterfacesUnderV243Test-1101867593-project-member] Enqueued Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_rules [ 1074.666150] env[68109]: INFO networking_nsxv3.common.synchronization [req-4bdce4d0-9c38-4fd8-8e1d-3f02b18e8c32 req-05fa2868-fc3a-4d12-89f8-20a51ab87971 tempest-AttachInterfacesUnderV243Test-1101867593 tempest-AttachInterfacesUnderV243Test-1101867593-project-member] Enqueued Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_members [ 1074.666150] env[68109]: INFO networking_nsxv3.common.synchronization [req-4bdce4d0-9c38-4fd8-8e1d-3f02b18e8c32 req-05fa2868-fc3a-4d12-89f8-20a51ab87971 tempest-AttachInterfacesUnderV243Test-1101867593 tempest-AttachInterfacesUnderV243Test-1101867593-project-member] Enqueued Resource ID: 883cba4a-2b86-4af1-baa0-afc92e9fa4b1 with Priority: HIGHEST for action port [ 1074.666150] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_rules [ 1074.666150] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_members [ 1074.666150] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 883cba4a-2b86-4af1-baa0-afc92e9fa4b1 with Priority: HIGHEST for action port [ 1074.666988] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd411cb2-c40e-46e4-a754-136e1fddced1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.666988] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.666988] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.667195] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.667300] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.668804] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd411cb2-c40e-46e4-a754-136e1fddced1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.668804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.668804] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.668804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.668998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.669101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.669177] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('883cba4a-2b86-4af1-baa0-afc92e9fa4b1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.800577] env[68109]: INFO networking_nsxv3.common.synchronization [None req-debd721e-723b-43d4-9bd0-f7eb1ab1e5d8 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1074.800966] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1074.801819] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.801990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.802078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.802247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.802401] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.802499] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.802559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.802700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.802779] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.802870] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.947217] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a565832-732a-4ead-8829-a1e204cdbc42: rpc.has_security_group_logging(os_id): False [ 1074.964396] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.964546] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.964611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.964853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.964940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.965188] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.965279] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.965341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.965495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.965573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.965749] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.965834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.965953] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.966083] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.966185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.966346] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.966434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.966496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.966625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.966695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.966787] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a565832-732a-4ead-8829-a1e204cdbc42 is going to be created. [ 1075.018645] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.018878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.018878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.019088] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.019275] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.032777] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a565832-732a-4ead-8829-a1e204cdbc42 in Status: IN_PROGRESS for 2s [ 1075.136819] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.171511] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd411cb2-c40e-46e4-a754-136e1fddced1 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.171663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.171832] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 883cba4a-2b86-4af1-baa0-afc92e9fa4b1 with status ACTIVE [ 1075.172021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.172119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.172188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.174035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.174035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.174035] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.174035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.174035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.174035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.174035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.174035] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.174035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.174035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.174035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.174035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.174035] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 883cba4a-2b86-4af1-baa0-afc92e9fa4b1 is going to be updated. [ 1075.193352] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.193352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.193352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.193352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.193352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.193712] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.305757] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.305757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.305757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.306233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.334751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.334751] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.334864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.334951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.336090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.336090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.336090] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 1075.362482] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.362686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.362686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.362906] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.363088] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.371739] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 1075.643122] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.148024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.148024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.148024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.148024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.148024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.148024] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd411cb2-c40e-46e4-a754-136e1fddced1 is going to be updated. [ 1076.175196] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.175196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.175196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.175196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.175579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.184581] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd411cb2-c40e-46e4-a754-136e1fddced1 in Status: IN_PROGRESS for 2s [ 1077.045438] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a565832-732a-4ead-8829-a1e204cdbc42 in Status: SUCCESS [ 1077.045675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.081254] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-973 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.081254] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-973" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.081254] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-973" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.081491] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-973" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.081821] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.082069] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.082247] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.082516] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.082700] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.082948] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.083124] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.083267] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.083405] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.083546] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.083680] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.083854] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.100900] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.101095] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1077.101247] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.101429] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-973" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.101755] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-79d1c435-b96b-4aff-bd9e-b0be86082816 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.101937] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.102077] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.102360] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.102507] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79d1c435-b96b-4aff-bd9e-b0be86082816',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.192453] env[68109]: INFO networking_nsxv3.common.synchronization [req-5866738c-70f3-4d9f-bd96-8d2e824b2851 req-d0be6d53-a987-4c97-914c-e8be85349b32 tempest-AttachInterfacesUnderV243Test-1101867593 tempest-AttachInterfacesUnderV243Test-1101867593-project-member] Enqueued Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_members [ 1077.193071] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_members [ 1077.193446] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd411cb2-c40e-46e4-a754-136e1fddced1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.193505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.210919] env[68109]: INFO networking_nsxv3.common.synchronization [req-5866738c-70f3-4d9f-bd96-8d2e824b2851 req-d0be6d53-a987-4c97-914c-e8be85349b32 tempest-AttachInterfacesUnderV243Test-1101867593 tempest-AttachInterfacesUnderV243Test-1101867593-project-member] Enqueued Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_rules [ 1077.211173] env[68109]: INFO networking_nsxv3.common.synchronization [req-5866738c-70f3-4d9f-bd96-8d2e824b2851 req-d0be6d53-a987-4c97-914c-e8be85349b32 tempest-AttachInterfacesUnderV243Test-1101867593 tempest-AttachInterfacesUnderV243Test-1101867593-project-member] Enqueued Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_members [ 1077.211376] env[68109]: INFO networking_nsxv3.common.synchronization [req-5866738c-70f3-4d9f-bd96-8d2e824b2851 req-d0be6d53-a987-4c97-914c-e8be85349b32 tempest-AttachInterfacesUnderV243Test-1101867593 tempest-AttachInterfacesUnderV243Test-1101867593-project-member] Enqueued Resource ID: 883cba4a-2b86-4af1-baa0-afc92e9fa4b1 with Priority: HIGHEST for action port [ 1077.211986] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_rules [ 1077.212181] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_members [ 1077.212280] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 883cba4a-2b86-4af1-baa0-afc92e9fa4b1 with Priority: HIGHEST for action port [ 1077.212628] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd411cb2-c40e-46e4-a754-136e1fddced1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.212725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.212940] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd411cb2-c40e-46e4-a754-136e1fddced1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.213043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.213281] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.213401] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.213464] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.213670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.213745] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('883cba4a-2b86-4af1-baa0-afc92e9fa4b1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.380901] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 1077.381125] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf deletion is rescheduled due to dependency. [ 1077.381252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.604906] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.605180] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.605552] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.605621] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.605773] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.606250] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.606313] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.606468] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.606762] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.606816] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.607148] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.607332] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.607513] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.607661] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.607926] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.607957] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 79d1c435-b96b-4aff-bd9e-b0be86082816 is going to be updated. [ 1077.630643] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.630958] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.631035] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.631304] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.631507] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.631739] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.681403] env[68109]: INFO networking_nsxv3.common.synchronization [req-0698e5f3-b276-4a42-bc8d-c41979e8e4e5 req-c2e02f31-ea6d-44f7-b9a4-501e6214baf7 tempest-DeleteServersTestJSON-2063667557 tempest-DeleteServersTestJSON-2063667557-project-member] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 1077.681839] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGHEST for action security_group_members [ 1077.682156] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.682282] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.682349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.682546] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.682688] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.682784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.682843] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.682984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.683163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.683304] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.716967] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 883cba4a-2b86-4af1-baa0-afc92e9fa4b1 with status ACTIVE [ 1077.717291] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.717455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.717543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.717776] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.717888] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.718088] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.718185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.718244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.718417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.718643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.718699] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.718752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.718809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.718941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.719032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.719115] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 883cba4a-2b86-4af1-baa0-afc92e9fa4b1 is going to be updated. [ 1077.742630] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.742821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.742899] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.743204] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.744156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.744156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-883cba4a-2b86-4af1-baa0-afc92e9fa4b1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.188056] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.188056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.188056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.188056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.197129] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd411cb2-c40e-46e4-a754-136e1fddced1 in Status: SUCCESS [ 1078.197129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.197129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.197129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.197129] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.197129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.197129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.198169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.198169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.198169] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.205356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.205729] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.205905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.206048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.206311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.206457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.206632] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be updated. [ 1078.233084] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.233490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.233490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.233490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.233620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.241320] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: IN_PROGRESS for 2s [ 1078.365021] env[68109]: INFO networking_nsxv3.common.synchronization [req-aca6dc96-e6d4-42ee-a3f9-b30fdabe13ca req-d5b93fbe-614d-4767-8e3c-89815713fd3a service nova] Enqueued Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_rules [ 1078.365021] env[68109]: INFO networking_nsxv3.common.synchronization [req-aca6dc96-e6d4-42ee-a3f9-b30fdabe13ca req-d5b93fbe-614d-4767-8e3c-89815713fd3a service nova] Enqueued Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_members [ 1078.365021] env[68109]: INFO networking_nsxv3.common.synchronization [req-aca6dc96-e6d4-42ee-a3f9-b30fdabe13ca req-d5b93fbe-614d-4767-8e3c-89815713fd3a service nova] Enqueued Resource ID: 79d1c435-b96b-4aff-bd9e-b0be86082816 with Priority: HIGHEST for action port [ 1078.365517] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_rules [ 1078.365812] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_members [ 1078.366033] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79d1c435-b96b-4aff-bd9e-b0be86082816 with Priority: HIGHEST for action port [ 1078.366595] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.366871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.367070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.367440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.369581] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.369581] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.369581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.369581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.369581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.369581] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.369581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.369581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.369581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.373297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.373297] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.374078] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-79d1c435-b96b-4aff-bd9e-b0be86082816 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.374251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.374319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.374485] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.374786] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79d1c435-b96b-4aff-bd9e-b0be86082816',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.700330] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.880033] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.880033] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.880033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.880033] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79d1c435-b96b-4aff-bd9e-b0be86082816 with status ACTIVE [ 1078.880033] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.880033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.880033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.880033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.880033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.880033] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.880033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.880033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.881573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.881838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.882297] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.882612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.882767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.883118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.883288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.883450] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79d1c435-b96b-4aff-bd9e-b0be86082816 is going to be updated. [ 1078.904068] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.904446] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.904623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.904904] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.905155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.905409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79d1c435-b96b-4aff-bd9e-b0be86082816" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.202494] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.385468] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.705367] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.705631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.705799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.706076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.706200] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.706309] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd411cb2-c40e-46e4-a754-136e1fddced1 is going to be updated. [ 1079.734420] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.734618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.734660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.734855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.735027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.744418] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd411cb2-c40e-46e4-a754-136e1fddced1 in Status: IN_PROGRESS for 2s [ 1079.887762] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.887946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.888036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.888254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.888340] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.888440] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b is going to be updated. [ 1079.920518] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.920737] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.920737] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.921168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.921168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.928914] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: IN_PROGRESS for 2s [ 1080.125610] env[68109]: INFO networking_nsxv3.common.synchronization [req-20bc414f-fc29-4a4b-99ec-d95085eed105 req-3216d9b8-5423-40c2-a0d7-577865c16eaf tempest-ServersAdminTestJSON-278829923 tempest-ServersAdminTestJSON-278829923-project-member] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1080.126217] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1080.126534] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.126659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.126726] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.126931] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.128818] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.128818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.128818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.128818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.128818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.128818] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.251617] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 in Status: SUCCESS [ 1080.251617] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 deletion is rescheduled due to dependency. [ 1080.251617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.481369] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.481726] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.482015] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.482488] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.482969] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.483326] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.483612] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.484501] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.484501] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.484749] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.484992] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.485274] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.485525] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.485824] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.486078] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.486484] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.504530] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.504721] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1080.504868] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.505075] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-856" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.505401] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-d6c88172-2cc0-4c67-bbc4-ac787e84c94e taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.505578] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-d6c88172-2cc0-4c67-bbc4-ac787e84c94e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.505702] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-d6c88172-2cc0-4c67-bbc4-ac787e84c94e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.506070] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-d6c88172-2cc0-4c67-bbc4-ac787e84c94e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.506304] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6c88172-2cc0-4c67-bbc4-ac787e84c94e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.630697] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.008592] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.008909] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.008983] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.009507] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.009707] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.009880] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port d6c88172-2cc0-4c67-bbc4-ac787e84c94e not found, creating... [ 1081.010254] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.010452] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.010550] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.010944] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.011114] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.011433] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.011614] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.011765] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.012042] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.012198] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.012350] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: d6c88172-2cc0-4c67-bbc4-ac787e84c94e is going to be created. [ 1081.034066] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.034332] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.034467] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.034862] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.035114] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.035351] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-d6c88172-2cc0-4c67-bbc4-ac787e84c94e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.134306] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.323774] env[68109]: INFO networking_nsxv3.common.synchronization [req-5cde6f76-4387-4f36-936a-b1645a0eaff8 req-f7b29428-91e6-4dec-90f6-1b2ec6cfda79 tempest-AttachInterfacesUnderV243Test-1101867593 tempest-AttachInterfacesUnderV243Test-1101867593-project-member] Enqueued Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_members [ 1081.324619] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd411cb2-c40e-46e4-a754-136e1fddced1 with Priority: HIGHEST for action security_group_members [ 1081.325409] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd411cb2-c40e-46e4-a754-136e1fddced1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.325597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.640815] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.641010] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.641102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.641403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.641403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.641531] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be updated. [ 1081.671707] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.671707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.671707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.671707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.671707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.678294] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1081.740720] env[68109]: INFO networking_nsxv3.common.synchronization [req-20bc414f-fc29-4a4b-99ec-d95085eed105 req-b2618149-4e6f-4c05-b76c-6e2337650f0c service nova] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_rules [ 1081.740931] env[68109]: INFO networking_nsxv3.common.synchronization [req-20bc414f-fc29-4a4b-99ec-d95085eed105 req-b2618149-4e6f-4c05-b76c-6e2337650f0c service nova] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1081.741123] env[68109]: INFO networking_nsxv3.common.synchronization [req-20bc414f-fc29-4a4b-99ec-d95085eed105 req-b2618149-4e6f-4c05-b76c-6e2337650f0c service nova] Enqueued Resource ID: d6c88172-2cc0-4c67-bbc4-ac787e84c94e with Priority: HIGHEST for action port [ 1081.741665] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_rules [ 1081.741809] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1081.741919] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c88172-2cc0-4c67-bbc4-ac787e84c94e with Priority: HIGHEST for action port [ 1081.746321] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.746459] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.746525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.746733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.746811] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.748105] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.748198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.750020] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6c88172-2cc0-4c67-bbc4-ac787e84c94e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.750020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6c88172-2cc0-4c67-bbc4-ac787e84c94e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.750020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6c88172-2cc0-4c67-bbc4-ac787e84c94e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.750020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6c88172-2cc0-4c67-bbc4-ac787e84c94e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.750020] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6c88172-2cc0-4c67-bbc4-ac787e84c94e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.780346] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd411cb2-c40e-46e4-a754-136e1fddced1 in Status: SUCCESS [ 1081.780605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.780770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.780981] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.781300] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.781400] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.781400] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.781970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.781970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.781970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.781970] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.782734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.784453] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.784453] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.784453] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.786135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.786322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.786412] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.786523] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.938437] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: SUCCESS [ 1081.938700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.939046] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.939235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.939504] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.939691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.939745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.940870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.940870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.940870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.940870] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.240725] env[68109]: INFO networking_nsxv3.common.synchronization [None req-5376300b-e998-4432-823d-16c8a1fef017 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 with Priority: HIGHEST for action security_group_rules [ 1082.240725] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 with Priority: HIGHEST for action security_group_rules [ 1082.240996] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-808f3a38-1a93-411e-a57b-76c6b18b7c52 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.241166] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.241252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.241571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.241783] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('808f3a38-1a93-411e-a57b-76c6b18b7c52',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.251124] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.251229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.253669] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6c88172-2cc0-4c67-bbc4-ac787e84c94e with status ACTIVE [ 1082.253861] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.253980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.254057] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.254279] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.254372] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.254538] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.254663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.254689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.254834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.254912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.255104] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.255197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.255258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.255396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.255468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.255552] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6c88172-2cc0-4c67-bbc4-ac787e84c94e is going to be updated. [ 1082.280971] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.281174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.281174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.281475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.281520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.281680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6c88172-2cc0-4c67-bbc4-ac787e84c94e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.289098] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.290094] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.290255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.290326] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.290473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.319816] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.320530] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.320761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.321082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.321342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.321566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.321685] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd411cb2-c40e-46e4-a754-136e1fddced1 is going to be updated. [ 1082.328062] env[68109]: INFO networking_nsxv3.common.synchronization [None req-c7472d04-2345-4f49-88fe-3dd48a8fd572 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 with Priority: HIGHEST for action security_group_rules [ 1082.328566] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 with Priority: HIGHEST for action security_group_rules [ 1082.328856] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-808f3a38-1a93-411e-a57b-76c6b18b7c52 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.328947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.362710] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.364037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.364037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.364037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.364037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.376283] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd411cb2-c40e-46e4-a754-136e1fddced1 in Status: IN_PROGRESS for 2s [ 1082.443127] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.443282] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.443346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.443526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.443702] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.443817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.443871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.444087] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.444187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.444280] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.444439] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.444533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.444592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.444739] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.444881] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.444975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.445035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.445207] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.445395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.445513] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.445615] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.773307] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.773307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.773307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.773307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.773307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.773307] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 already deleted. [ 1082.773307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.773594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.773689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.773774] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('808f3a38-1a93-411e-a57b-76c6b18b7c52',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.793606] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd411cb2-c40e-46e4-a754-136e1fddced1: rpc.has_security_group_logging(os_id): False [ 1082.819724] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.821037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.821037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.821037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.821037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.821037] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.821037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.821037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.821037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.821037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.821358] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd411cb2-c40e-46e4-a754-136e1fddced1 is going to be updated. [ 1082.921023] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.921023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.921023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.921023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.921023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.948975] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3bcda49a-0e74-4618-bd35-62ff5440bd3b: rpc.has_security_group_logging(os_id): False [ 1082.965586] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd411cb2-c40e-46e4-a754-136e1fddced1 in Status: IN_PROGRESS for 2s [ 1083.029120] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.029120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.029120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.029120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.029120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.029120] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.029120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.029120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.029120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.029120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.029120] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.029120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.029120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.029120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.029120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.032229] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.032229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.032229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.032229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.032229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.032229] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b is going to be created. [ 1083.123356] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.123356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.123356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.123356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.123356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.140228] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: IN_PROGRESS for 2s [ 1083.296403] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.296597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.296642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.296888] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.297056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.297141] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 already deleted. [ 1083.297231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.690833] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1083.690833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.690833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.690833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.690833] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.690833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.690833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.690833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.690833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.690833] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.195824] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.387053] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd411cb2-c40e-46e4-a754-136e1fddced1 in Status: SUCCESS [ 1084.387394] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd411cb2-c40e-46e4-a754-136e1fddced1 deletion is rescheduled due to dependency. [ 1084.387583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.387843] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.388203] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.388602] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.388829] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.388944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.389234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.389399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.389578] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.697841] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.892624] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.892856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.892856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.893140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.893257] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.893540] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.893655] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.893699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.893862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.893983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.894130] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd411cb2-c40e-46e4-a754-136e1fddced1 is going to be updated. [ 1084.921753] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.921911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.921983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.922270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.922413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.933152] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd411cb2-c40e-46e4-a754-136e1fddced1 in Status: IN_PROGRESS for 2s [ 1084.981409] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd411cb2-c40e-46e4-a754-136e1fddced1 in Status: SUCCESS [ 1084.981734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.981944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.982209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.982317] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.171680] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: SUCCESS [ 1085.171933] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.200594] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.200770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.201531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.201531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.201531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.201531] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be updated. [ 1085.232521] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.232521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.232521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.232521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.232521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.244566] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1085.504625] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.504625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.504625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.504908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.504908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.504978] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd411cb2-c40e-46e4-a754-136e1fddced1 is going to be deleted. [ 1085.558939] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.559898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.559898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.559898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.559898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.559898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.396068] env[68109]: INFO networking_nsxv3.common.synchronization [req-e8657ebb-3158-4f0f-8f95-233f4fff2a69 req-a478e10b-75b0-4532-9aad-baa18b04a424 tempest-ServerRescueNegativeTestJSON-575486598 tempest-ServerRescueNegativeTestJSON-575486598-project-member] Enqueued Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_members [ 1086.396664] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGHEST for action security_group_members [ 1086.396981] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.397140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.397216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.397421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.397575] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.397675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.397733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.397886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.397973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.398069] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.900507] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.900683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.900755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.900985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.901093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.901292] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.901391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.901451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.901598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.901672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.901756] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 is going to be updated. [ 1086.917626] env[68109]: INFO networking_nsxv3.common.synchronization [req-bd93cf71-1e52-4397-a837-c82f75b2f3da req-ea8a0ffb-b369-4d1a-ba65-44e585da4e19 tempest-ImagesOneServerNegativeTestJSON-1955885897 tempest-ImagesOneServerNegativeTestJSON-1955885897-project-member] Enqueued Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1086.918119] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1086.918787] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.918787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.918787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.918787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.918942] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.918997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.919264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.919350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.919432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.919525] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.937229] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.937391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.937462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.937705] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.937846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.947742] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd411cb2-c40e-46e4-a754-136e1fddced1 in Status: SUCCESS [ 1086.948147] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd411cb2-c40e-46e4-a754-136e1fddced1 deletion is rescheduled due to dependency. [ 1086.948147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.948249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.948348] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.948521] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.948631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.948694] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.948841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.948925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.949043] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd411cb2-c40e-46e4-a754-136e1fddced1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.950379] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: IN_PROGRESS for 2s [ 1087.291440] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1087.291649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.291742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.292581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.292799] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.292959] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.293039] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.293229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.293315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.293440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.293528] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.421981] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.422329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.422329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.422429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.422512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.422718] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.422817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.422876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.423038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.423117] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.423205] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab is going to be updated. [ 1087.451532] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.451709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.451749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.451969] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.452070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.452282] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.452391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.452454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.452616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.452693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.452780] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd411cb2-c40e-46e4-a754-136e1fddced1 is going to be deleted. [ 1087.454728] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.454728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.454912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.454979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.455148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.465954] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: IN_PROGRESS for 2s [ 1087.488755] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.489030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.489030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.489360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.489467] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.489576] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd411cb2-c40e-46e4-a754-136e1fddced1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.797409] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.797723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.797798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.798057] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.798257] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.798526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.798526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.798676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.798809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.799454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.799454] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.799454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.799454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.799454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.799923] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.799923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.799923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.800042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.800042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.800152] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.800213] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.302910] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f55a1eeb-30c3-44c5-bd92-57dad54e2585: rpc.has_security_group_logging(os_id): False [ 1088.324205] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.324205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.324205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.324397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.324468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.324681] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.324809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.324889] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.325144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.325229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.325526] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.325683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.325787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.326047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.326217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.326493] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.327186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.327186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.327186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.327186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.327186] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be updated. [ 1088.388627] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.388814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.388889] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.389133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.389289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.408744] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1088.964118] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 in Status: SUCCESS [ 1088.964422] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 deletion is rescheduled due to dependency. [ 1088.964473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.475719] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: SUCCESS [ 1089.475719] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab deletion is rescheduled due to dependency. [ 1089.475719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.425402] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1090.425723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.530723] env[68109]: INFO networking_nsxv3.common.synchronization [req-164776ff-dce6-4245-8c79-bc281332fbc2 req-47698a63-a554-4753-b12a-02340c3c09c2 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 with Priority: HIGHEST for action security_group_members [ 1090.531250] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 with Priority: HIGHEST for action security_group_members [ 1090.531570] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-808f3a38-1a93-411e-a57b-76c6b18b7c52 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.531704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.531768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.532083] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.532304] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.532437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.532518] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.532709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.532817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.532935] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('808f3a38-1a93-411e-a57b-76c6b18b7c52',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.833039] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.833039] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.833039] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.833039] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.833039] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.833039] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.833039] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.833646] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.834165] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.834521] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.834987] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1090.835244] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1090.835574] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1090.835800] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.836021] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1090.836291] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1090.860418] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1090.860418] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1090.860418] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1090.860418] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.860418] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-8dac58de-dd0e-4741-8a91-6938a7c1377b taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.860418] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-8dac58de-dd0e-4741-8a91-6938a7c1377b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.860418] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-8dac58de-dd0e-4741-8a91-6938a7c1377b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.860418] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-8dac58de-dd0e-4741-8a91-6938a7c1377b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.860418] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dac58de-dd0e-4741-8a91-6938a7c1377b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.036347] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.036347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.036347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.036347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.036731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.037047] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.037284] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.037511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.037764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.038488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.038488] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 already deleted. [ 1091.038488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.362382] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.362625] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.362755] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.363130] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.363240] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.363403] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 8dac58de-dd0e-4741-8a91-6938a7c1377b not found, creating... [ 1091.363845] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.363845] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.363965] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.364212] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.364366] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.364719] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.364834] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.364957] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.368359] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.368359] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.368359] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 8dac58de-dd0e-4741-8a91-6938a7c1377b is going to be created. [ 1091.389228] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.389597] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.389786] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.390108] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.390377] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.390639] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-8dac58de-dd0e-4741-8a91-6938a7c1377b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.093972] env[68109]: INFO networking_nsxv3.common.synchronization [req-164776ff-dce6-4245-8c79-bc281332fbc2 req-bf79c33e-d4bf-4682-826b-66d6f807ab4c service nova] Enqueued Resource ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 with Priority: HIGHEST for action security_group_rules [ 1092.094339] env[68109]: INFO networking_nsxv3.common.synchronization [req-164776ff-dce6-4245-8c79-bc281332fbc2 req-bf79c33e-d4bf-4682-826b-66d6f807ab4c service nova] Enqueued Resource ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 with Priority: HIGHEST for action security_group_members [ 1092.094339] env[68109]: INFO networking_nsxv3.common.synchronization [req-164776ff-dce6-4245-8c79-bc281332fbc2 req-bf79c33e-d4bf-4682-826b-66d6f807ab4c service nova] Enqueued Resource ID: 8dac58de-dd0e-4741-8a91-6938a7c1377b with Priority: HIGHEST for action port [ 1092.094550] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 with Priority: HIGHEST for action security_group_rules [ 1092.094673] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 with Priority: HIGHEST for action security_group_members [ 1092.094769] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dac58de-dd0e-4741-8a91-6938a7c1377b with Priority: HIGHEST for action port [ 1092.095368] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-808f3a38-1a93-411e-a57b-76c6b18b7c52 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.095474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.095543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.095735] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.095817] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('808f3a38-1a93-411e-a57b-76c6b18b7c52',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.097034] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-808f3a38-1a93-411e-a57b-76c6b18b7c52 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.100178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.100347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.100449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.100599] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.100699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.100759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.100907] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.101013] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.101107] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('808f3a38-1a93-411e-a57b-76c6b18b7c52',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.102157] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dac58de-dd0e-4741-8a91-6938a7c1377b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.102282] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dac58de-dd0e-4741-8a91-6938a7c1377b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.102352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dac58de-dd0e-4741-8a91-6938a7c1377b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.102508] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dac58de-dd0e-4741-8a91-6938a7c1377b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.102585] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dac58de-dd0e-4741-8a91-6938a7c1377b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.605116] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('808f3a38-1a93-411e-a57b-76c6b18b7c52',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.606089] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-808f3a38-1a93-411e-a57b-76c6b18b7c52 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.606205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.606389] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dac58de-dd0e-4741-8a91-6938a7c1377b with status ACTIVE [ 1092.606549] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.606659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.606723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.606922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.607023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.607193] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.607328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.607426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.607610] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.607691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.607871] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.607965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.609089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.609282] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.609369] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.609460] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dac58de-dd0e-4741-8a91-6938a7c1377b is going to be updated. [ 1092.632353] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.633023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.633023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.633023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.633023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.633023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dac58de-dd0e-4741-8a91-6938a7c1377b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.953999] env[68109]: INFO networking_nsxv3.common.synchronization [None req-36954f6d-c0a1-441c-933d-8567d476bd3c None None] Enqueued Resource ID: b67f5c0b-f24d-4fc5-953d-f395df474031 with Priority: HIGHEST for action port [ 1092.954292] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b67f5c0b-f24d-4fc5-953d-f395df474031 with Priority: HIGHEST for action port [ 1092.955140] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-b67f5c0b-f24d-4fc5-953d-f395df474031 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.955140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b67f5c0b-f24d-4fc5-953d-f395df474031" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.955140] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b67f5c0b-f24d-4fc5-953d-f395df474031" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.955331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b67f5c0b-f24d-4fc5-953d-f395df474031" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.956072] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b67f5c0b-f24d-4fc5-953d-f395df474031',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.111393] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('808f3a38-1a93-411e-a57b-76c6b18b7c52',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.458116] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b67f5c0b-f24d-4fc5-953d-f395df474031 [ 1093.459272] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.459272] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.459272] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.459272] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.459272] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.459272] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b67f5c0b-f24d-4fc5-953d-f395df474031 already deleted. [ 1093.459272] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b67f5c0b-f24d-4fc5-953d-f395df474031" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.616123] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.616305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.616377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.616617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.616711] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.616811] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 is going to be created. [ 1093.643078] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.643078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.643078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.643308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.643492] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.651671] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 in Status: UNINITIALIZED for 2s [ 1093.762756] env[68109]: INFO networking_nsxv3.common.synchronization [None req-8dd95ac7-707c-4176-8834-bc4b5646818d tempest-ImagesOneServerNegativeTestJSON-1955885897 tempest-ImagesOneServerNegativeTestJSON-1955885897-project-member] Enqueued Resource ID: f9b8eb79-97be-4f52-ae18-f2cdbfad7640 with Priority: HIGHEST for action security_group_rules [ 1093.763342] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9b8eb79-97be-4f52-ae18-f2cdbfad7640 with Priority: HIGHEST for action security_group_rules [ 1093.763960] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9b8eb79-97be-4f52-ae18-f2cdbfad7640 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.763960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9b8eb79-97be-4f52-ae18-f2cdbfad7640" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.763960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9b8eb79-97be-4f52-ae18-f2cdbfad7640" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.764517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9b8eb79-97be-4f52-ae18-f2cdbfad7640" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.764629] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9b8eb79-97be-4f52-ae18-f2cdbfad7640',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.900862] env[68109]: INFO networking_nsxv3.common.synchronization [None req-4ef0cfd7-6461-4ba2-93df-d267276afaa6 tempest-ImagesOneServerNegativeTestJSON-1955885897 tempest-ImagesOneServerNegativeTestJSON-1955885897-project-member] Enqueued Resource ID: f9b8eb79-97be-4f52-ae18-f2cdbfad7640 with Priority: HIGHEST for action security_group_rules [ 1093.901438] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9b8eb79-97be-4f52-ae18-f2cdbfad7640 with Priority: HIGHEST for action security_group_rules [ 1093.901734] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9b8eb79-97be-4f52-ae18-f2cdbfad7640 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.901831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9b8eb79-97be-4f52-ae18-f2cdbfad7640" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.286879] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.287194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.287194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.287831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.287831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.287831] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9b8eb79-97be-4f52-ae18-f2cdbfad7640 already deleted. [ 1094.287831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9b8eb79-97be-4f52-ae18-f2cdbfad7640" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.287831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9b8eb79-97be-4f52-ae18-f2cdbfad7640" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.288218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9b8eb79-97be-4f52-ae18-f2cdbfad7640" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.290162] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9b8eb79-97be-4f52-ae18-f2cdbfad7640',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.667768] env[68109]: INFO networking_nsxv3.common.synchronization [None req-2d5f3366-afc2-43b9-ba86-98ca85391acd tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c with Priority: HIGHEST for action security_group_rules [ 1094.670256] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c with Priority: HIGHEST for action security_group_rules [ 1094.670256] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.670256] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.670435] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.673030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.673030] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fef5c6c-c6aa-4088-93a6-194fafd50d0c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.805395] env[68109]: INFO networking_nsxv3.common.synchronization [None req-f461ef0a-2a3b-4bf7-a9e9-93de76687145 tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c with Priority: HIGHEST for action security_group_rules [ 1094.805395] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c with Priority: HIGHEST for action security_group_rules [ 1094.805395] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.805395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.811589] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.811589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.811589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.811589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.811589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.811589] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9b8eb79-97be-4f52-ae18-f2cdbfad7640 already deleted. [ 1094.811589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9b8eb79-97be-4f52-ae18-f2cdbfad7640" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.192202] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.192342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.192397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.192620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.192732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.192836] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c already deleted. [ 1095.193060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.193144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.193263] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.193345] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fef5c6c-c6aa-4088-93a6-194fafd50d0c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.221828] env[68109]: INFO networking_nsxv3.common.synchronization [None req-03e9714d-71da-40b6-b2be-d3e742d482e9 None None] Enqueued Resource ID: ee341741-c918-4997-9ace-576aa92afa5b with Priority: HIGHEST for action port [ 1095.222335] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee341741-c918-4997-9ace-576aa92afa5b with Priority: HIGHEST for action port [ 1095.222989] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee341741-c918-4997-9ace-576aa92afa5b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.222989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee341741-c918-4997-9ace-576aa92afa5b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.225722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee341741-c918-4997-9ace-576aa92afa5b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.225722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee341741-c918-4997-9ace-576aa92afa5b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.225722] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee341741-c918-4997-9ace-576aa92afa5b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.661036] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 in Status: SUCCESS [ 1095.661312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.661476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.661688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.661878] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.661995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.662075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.662224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.662304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.662389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.662482] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('808f3a38-1a93-411e-a57b-76c6b18b7c52',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.715814] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.716014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.716014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.716139] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.716232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.716393] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c already deleted. [ 1095.716478] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.727923] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee341741-c918-4997-9ace-576aa92afa5b [ 1095.728146] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.728272] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.728340] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.728528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.728760] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.728874] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee341741-c918-4997-9ace-576aa92afa5b already deleted. [ 1095.728972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee341741-c918-4997-9ace-576aa92afa5b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.164167] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('808f3a38-1a93-411e-a57b-76c6b18b7c52',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.419596] env[68109]: INFO networking_nsxv3.common.synchronization [req-459487c1-a4bd-47e3-a2d4-f9b8a6c20809 req-e28a2ad3-34f4-4ddc-80a7-b33fdea9be6e tempest-ServerRescueTestJSON-1286138287 tempest-ServerRescueTestJSON-1286138287-project-member] Enqueued Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_members [ 1096.420588] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_members [ 1096.421287] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.421287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.421287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.421498] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.421579] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.421709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.421780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.421950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.422057] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.422156] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.668461] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 808f3a38-1a93-411e-a57b-76c6b18b7c52: rpc.has_security_group_logging(os_id): False [ 1096.685849] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.686589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.686709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.687017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.687170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.687474] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.687598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.687673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.687853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.687943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.688069] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 is going to be created. [ 1096.744292] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.744438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.744529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.744772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.745044] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.756409] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 in Status: IN_PROGRESS for 2s [ 1096.857187] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-996 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.857436] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-996" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.857549] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-996" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.857818] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-996" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.858095] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.858249] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.858368] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.858590] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.859236] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.859236] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.859236] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.859236] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.859572] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.859572] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.859572] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.859668] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.881662] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.881790] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1096.881935] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.882281] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-996" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.882908] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-1a3dc25e-da6c-4d0c-bfc6-72d616ac8120 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.883584] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-1a3dc25e-da6c-4d0c-bfc6-72d616ac8120" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.883584] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-1a3dc25e-da6c-4d0c-bfc6-72d616ac8120" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.883924] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-1a3dc25e-da6c-4d0c-bfc6-72d616ac8120" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.884215] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a3dc25e-da6c-4d0c-bfc6-72d616ac8120',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.925533] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.387580] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.387580] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.387756] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.388118] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.388118] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.388291] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 1a3dc25e-da6c-4d0c-bfc6-72d616ac8120 not found, creating... [ 1097.388479] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.388715] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.388777] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.389026] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.389219] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.389403] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.389559] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.389679] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.389886] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.390032] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.390179] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 1a3dc25e-da6c-4d0c-bfc6-72d616ac8120 is going to be created. [ 1097.411172] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.411172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.411172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.411172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.411172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.411172] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-1a3dc25e-da6c-4d0c-bfc6-72d616ac8120" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.429782] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.932034] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.932034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.932034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.932506] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.932506] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.932506] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a565832-732a-4ead-8829-a1e204cdbc42 is going to be updated. [ 1097.959889] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.960078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.960143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.960396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.960566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.970351] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a565832-732a-4ead-8829-a1e204cdbc42 in Status: IN_PROGRESS for 2s [ 1098.171432] env[68109]: INFO networking_nsxv3.common.synchronization [req-459487c1-a4bd-47e3-a2d4-f9b8a6c20809 req-4d89574d-057d-455f-af4e-106daea24121 service nova] Enqueued Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_rules [ 1098.171661] env[68109]: INFO networking_nsxv3.common.synchronization [req-459487c1-a4bd-47e3-a2d4-f9b8a6c20809 req-4d89574d-057d-455f-af4e-106daea24121 service nova] Enqueued Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_members [ 1098.171815] env[68109]: INFO networking_nsxv3.common.synchronization [req-459487c1-a4bd-47e3-a2d4-f9b8a6c20809 req-4d89574d-057d-455f-af4e-106daea24121 service nova] Enqueued Resource ID: 1a3dc25e-da6c-4d0c-bfc6-72d616ac8120 with Priority: HIGHEST for action port [ 1098.172056] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_rules [ 1098.172189] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_members [ 1098.172311] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a3dc25e-da6c-4d0c-bfc6-72d616ac8120 with Priority: HIGHEST for action port [ 1098.172861] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.173170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.173297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.173477] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.173565] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.174393] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.174505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.174680] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a3dc25e-da6c-4d0c-bfc6-72d616ac8120 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.174812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a3dc25e-da6c-4d0c-bfc6-72d616ac8120" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.174879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a3dc25e-da6c-4d0c-bfc6-72d616ac8120" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.174991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a3dc25e-da6c-4d0c-bfc6-72d616ac8120" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.175080] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a3dc25e-da6c-4d0c-bfc6-72d616ac8120',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.677033] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.677033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.677033] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a3dc25e-da6c-4d0c-bfc6-72d616ac8120 with status ACTIVE [ 1098.677312] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.677312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.677436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.677567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.677725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.677930] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.678288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.678288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.678288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.678418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.678608] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.678743] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.678820] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.678990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.679110] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.679205] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a3dc25e-da6c-4d0c-bfc6-72d616ac8120 is going to be updated. [ 1098.699598] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.699751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.699839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.700018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.700187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.700358] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a3dc25e-da6c-4d0c-bfc6-72d616ac8120" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.770366] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 in Status: SUCCESS [ 1098.770366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.981505] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a565832-732a-4ead-8829-a1e204cdbc42 in Status: SUCCESS [ 1099.981817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.981950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.982454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.982454] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.982657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.982657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.982795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.982878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.982979] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.485782] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.988295] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.096028] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-656 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.096028] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.096028] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.096028] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.096028] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.096325] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.096325] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.096563] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.096715] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.096929] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1101.097077] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.097198] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.097331] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.097451] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1101.097561] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.097699] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.117388] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.117584] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1101.117751] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.117942] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-656" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.118297] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-1b47e5a5-5481-413d-b98e-9c69d26feef0 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.118500] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.118642] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.118927] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.119110] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b47e5a5-5481-413d-b98e-9c69d26feef0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.490622] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.490788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.490862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.491106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.491201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.491301] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a565832-732a-4ead-8829-a1e204cdbc42 is going to be updated. [ 1101.519516] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.519698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.519750] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.519956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.520122] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.528483] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a565832-732a-4ead-8829-a1e204cdbc42 in Status: IN_PROGRESS for 2s [ 1101.621942] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.622205] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.622363] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.623198] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.623455] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.623772] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.623945] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.624128] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.624405] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.624570] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.624876] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.625068] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.625195] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.625418] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.625577] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.625736] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 1b47e5a5-5481-413d-b98e-9c69d26feef0 is going to be updated. [ 1101.645484] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.645709] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.645843] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.646425] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.646425] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.646592] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.369461] env[68109]: INFO networking_nsxv3.common.synchronization [req-9ac0ff11-a624-454f-a4f9-77f84d667a8d req-7d60da5b-bb13-4256-b840-84d5700d87d8 service nova] Enqueued Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_rules [ 1102.369753] env[68109]: INFO networking_nsxv3.common.synchronization [req-9ac0ff11-a624-454f-a4f9-77f84d667a8d req-7d60da5b-bb13-4256-b840-84d5700d87d8 service nova] Enqueued Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_members [ 1102.369812] env[68109]: INFO networking_nsxv3.common.synchronization [req-9ac0ff11-a624-454f-a4f9-77f84d667a8d req-7d60da5b-bb13-4256-b840-84d5700d87d8 service nova] Enqueued Resource ID: 1b47e5a5-5481-413d-b98e-9c69d26feef0 with Priority: HIGHEST for action port [ 1102.370398] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_rules [ 1102.370513] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_members [ 1102.370612] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b47e5a5-5481-413d-b98e-9c69d26feef0 with Priority: HIGHEST for action port [ 1102.370898] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.373520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.373776] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.374029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.374139] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.375992] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.375992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.375992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.375992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.375992] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.375992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.376442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.376442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.376442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.376442] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.377423] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b47e5a5-5481-413d-b98e-9c69d26feef0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.377584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.379362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.379362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.379362] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b47e5a5-5481-413d-b98e-9c69d26feef0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.880567] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.880770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.881046] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.882815] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b47e5a5-5481-413d-b98e-9c69d26feef0 with status ACTIVE [ 1102.883774] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.883774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.883774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.883774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.883774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.883774] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.884198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.884198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.884198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.884198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.884610] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.884731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.884874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.885037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.885150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.885279] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b47e5a5-5481-413d-b98e-9c69d26feef0 is going to be updated. [ 1102.920241] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.920421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.920421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.920654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.920812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.920923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b47e5a5-5481-413d-b98e-9c69d26feef0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.384242] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.541887] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a565832-732a-4ead-8829-a1e204cdbc42 in Status: SUCCESS [ 1103.541887] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.541887] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.541887] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.541887] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.541887] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.541887] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.541887] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.541887] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.541887] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.541887] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.678474] env[68109]: INFO networking_nsxv3.common.synchronization [req-5cb9e4fa-2377-4ad1-8c86-edc9cfd556b8 req-141ac569-bd44-4d27-8cb3-6eea11e91692 tempest-ImagesOneServerNegativeTestJSON-1955885897 tempest-ImagesOneServerNegativeTestJSON-1955885897-project-member] Enqueued Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1103.678883] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1103.679513] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.679513] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.679642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.679836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.680123] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.680234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.680335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.680536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.680673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.680809] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.886630] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.886852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.886852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.887099] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.887217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.887285] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 is going to be updated. [ 1103.918096] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.918424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.918424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.918548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.918674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.927454] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 in Status: IN_PROGRESS for 2s [ 1104.015400] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-137 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.015601] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-137" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.015729] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-137" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.015999] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-137" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.016575] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.017390] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.017390] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.017390] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.017540] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.017727] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.017871] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.017986] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.018111] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.018236] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.018347] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.018487] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.036641] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.036883] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1104.037119] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.037372] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-137" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.037816] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-fff50311-3bfe-4037-8022-7aee071e8fe9 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.038084] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-fff50311-3bfe-4037-8022-7aee071e8fe9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.038268] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-fff50311-3bfe-4037-8022-7aee071e8fe9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.038713] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-fff50311-3bfe-4037-8022-7aee071e8fe9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.038932] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fff50311-3bfe-4037-8022-7aee071e8fe9',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.044712] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.044795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.044848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.045038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.045205] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.045302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.045917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.045917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.045917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.045917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.045917] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.045917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.046161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.046161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.046287] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.046432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.046498] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.046636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.046709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.046790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.046871] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.183534] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.184219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.184219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.184219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.184333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.184534] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.184656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.184730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.184926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.185033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.185147] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab is going to be updated. [ 1104.208226] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.208226] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.208226] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.209153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.209153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.219132] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: IN_PROGRESS for 2s [ 1104.544465] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.544465] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.544465] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.544465] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.544465] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.544465] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port fff50311-3bfe-4037-8022-7aee071e8fe9 not found, creating... [ 1104.544465] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.544465] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.544465] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.544465] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.544465] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.545140] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.545140] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.552651] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.552651] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.552651] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.552651] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: fff50311-3bfe-4037-8022-7aee071e8fe9 is going to be created. [ 1104.552651] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a565832-732a-4ead-8829-a1e204cdbc42: rpc.has_security_group_logging(os_id): False [ 1104.569098] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.569098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.569098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.569098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.569098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.569098] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.569098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.569098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.569098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.569098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.569098] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.569098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.569098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.569098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.569098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.569530] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.569530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.569530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.569530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.570174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.570414] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a565832-732a-4ead-8829-a1e204cdbc42 is going to be updated. [ 1104.572804] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.573227] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.573493] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.573955] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.574308] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.574700] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-fff50311-3bfe-4037-8022-7aee071e8fe9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.640588] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.640588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.640588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.640588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.640588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.659150] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a565832-732a-4ead-8829-a1e204cdbc42 in Status: IN_PROGRESS for 2s [ 1104.710772] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.710989] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.711134] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.711404] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.711668] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.711884] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.712437] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.712742] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.712957] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.713240] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.713419] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.713590] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.713747] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.713909] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.714077] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.714268] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.751456] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.751456] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1104.752159] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.752413] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.752759] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.753120] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.753311] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.753662] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.753840] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fe486e0-7c6b-4bfc-a56b-2e17bd922399',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.246446] env[68109]: INFO networking_nsxv3.common.synchronization [req-5cb9e4fa-2377-4ad1-8c86-edc9cfd556b8 req-51ee9c92-8569-4376-be77-3bfc831ea5a2 service nova] Enqueued Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_rules [ 1105.247333] env[68109]: INFO networking_nsxv3.common.synchronization [req-5cb9e4fa-2377-4ad1-8c86-edc9cfd556b8 req-51ee9c92-8569-4376-be77-3bfc831ea5a2 service nova] Enqueued Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1105.247333] env[68109]: INFO networking_nsxv3.common.synchronization [req-5cb9e4fa-2377-4ad1-8c86-edc9cfd556b8 req-51ee9c92-8569-4376-be77-3bfc831ea5a2 service nova] Enqueued Resource ID: fff50311-3bfe-4037-8022-7aee071e8fe9 with Priority: HIGHEST for action port [ 1105.247333] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_rules [ 1105.247562] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1105.247562] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff50311-3bfe-4037-8022-7aee071e8fe9 with Priority: HIGHEST for action port [ 1105.247791] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.247915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.247982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.249357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.249473] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.250275] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.250374] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.254023] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-fff50311-3bfe-4037-8022-7aee071e8fe9 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.254023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fff50311-3bfe-4037-8022-7aee071e8fe9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.254023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fff50311-3bfe-4037-8022-7aee071e8fe9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.254023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fff50311-3bfe-4037-8022-7aee071e8fe9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.254023] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fff50311-3bfe-4037-8022-7aee071e8fe9',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.256852] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.257128] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.258025] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.258025] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.258025] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.258025] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 0fe486e0-7c6b-4bfc-a56b-2e17bd922399 not found, creating... [ 1105.258248] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.258416] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.258489] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.259153] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.259153] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.259398] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.260027] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.260027] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.260341] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.260614] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.260614] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 0fe486e0-7c6b-4bfc-a56b-2e17bd922399 is going to be created. [ 1105.280176] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.280486] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.280670] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.281048] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.281357] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.281665] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.753973] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.754380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.755580] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fff50311-3bfe-4037-8022-7aee071e8fe9 with status ACTIVE [ 1105.755803] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.755925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.755992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.756226] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.756314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.756533] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.756629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.756990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.757316] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.757430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.757649] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.757749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.757818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.757981] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.758066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.758164] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fff50311-3bfe-4037-8022-7aee071e8fe9 is going to be updated. [ 1105.779583] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.779823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.779942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.780224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.780443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.780692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fff50311-3bfe-4037-8022-7aee071e8fe9" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.945043] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 in Status: SUCCESS [ 1105.945262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.945434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.945654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.945846] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.945965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.946060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.946223] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.946298] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.946484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.946594] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.228867] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: SUCCESS [ 1106.229123] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab deletion is rescheduled due to dependency. [ 1106.229199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.229365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.229587] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.229792] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.229913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.229992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.230164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.230350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.230590] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.291442] env[68109]: INFO networking_nsxv3.common.synchronization [req-082c98c0-db5b-48b2-82a5-de233fe049c8 req-2007fdac-cbe8-4157-901a-644e69f74e14 service nova] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_rules [ 1106.291744] env[68109]: INFO networking_nsxv3.common.synchronization [req-082c98c0-db5b-48b2-82a5-de233fe049c8 req-2007fdac-cbe8-4157-901a-644e69f74e14 service nova] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1106.292019] env[68109]: INFO networking_nsxv3.common.synchronization [req-082c98c0-db5b-48b2-82a5-de233fe049c8 req-2007fdac-cbe8-4157-901a-644e69f74e14 service nova] Enqueued Resource ID: 0fe486e0-7c6b-4bfc-a56b-2e17bd922399 with Priority: HIGHEST for action port [ 1106.292758] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_rules [ 1106.292966] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1106.295431] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe486e0-7c6b-4bfc-a56b-2e17bd922399 with Priority: HIGHEST for action port [ 1106.295816] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.295928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.295975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.296194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.296900] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.301438] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.301438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.301438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.301438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.301438] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.301438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.301438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.301438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.301438] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.301438] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.305698] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.305698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.305698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.305698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.305698] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fe486e0-7c6b-4bfc-a56b-2e17bd922399',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.403768] env[68109]: INFO networking_nsxv3.common.synchronization [req-86b1efe3-cb75-46d1-bbe7-c227ff2b40e5 req-4733f5c7-080e-41f4-9435-d0922b58358c tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c with Priority: HIGHEST for action security_group_members [ 1106.408544] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c with Priority: HIGHEST for action security_group_members [ 1106.409075] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.409199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.409264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.409520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.409681] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.409801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.409859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.410027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.410107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.410215] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fef5c6c-c6aa-4088-93a6-194fafd50d0c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.451287] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.671455] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a565832-732a-4ead-8829-a1e204cdbc42 in Status: SUCCESS [ 1106.671687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.732731] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.804536] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.804857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.804891] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.805862] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0fe486e0-7c6b-4bfc-a56b-2e17bd922399 with status ACTIVE [ 1106.806071] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.806192] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.806256] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.806522] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.806617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.806800] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.806997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.806997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.807177] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.807216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.807401] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.807523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.807592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.807795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.807875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.807962] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0fe486e0-7c6b-4bfc-a56b-2e17bd922399 is going to be updated. [ 1106.829347] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.829560] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.829560] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.829798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.829894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.830061] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.845914] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.846076] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.846213] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.846605] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.846880] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.847055] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.847173] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.847401] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.847598] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.847775] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.847894] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.848010] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.848127] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.848234] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.848342] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.848477] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.865770] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.865979] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1106.866102] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.866290] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.866765] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-c30a526a-1afd-45f5-96cf-83a4dab8a3a4 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.866874] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-c30a526a-1afd-45f5-96cf-83a4dab8a3a4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.866997] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-c30a526a-1afd-45f5-96cf-83a4dab8a3a4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.867352] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-c30a526a-1afd-45f5-96cf-83a4dab8a3a4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.867542] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c30a526a-1afd-45f5-96cf-83a4dab8a3a4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.912648] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.912874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.913185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.913185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.913301] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.913455] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.913549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.913610] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.913756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.913892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.913975] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c already deleted. [ 1106.914066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.953808] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 256c7a06-cd22-48f9-a904-ae2dd6fec0e8: rpc.has_security_group_logging(os_id): False [ 1106.971721] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.971889] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.971974] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.972254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.003008] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.003396] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.003665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.003665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.003876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.003965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.004074] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 is going to be updated. [ 1107.071788] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.072523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.072823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.078017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.078017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.094082] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 in Status: IN_PROGRESS for 2s [ 1107.236899] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.309983] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.370673] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.370887] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.371030] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.371331] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.371522] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.371701] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port c30a526a-1afd-45f5-96cf-83a4dab8a3a4 not found, creating... [ 1107.372624] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.372624] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.372624] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.372624] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.372831] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.373454] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.373454] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.373454] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.373454] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.373626] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.374218] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: c30a526a-1afd-45f5-96cf-83a4dab8a3a4 is going to be created. [ 1107.391924] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.392226] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.392524] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.392978] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.393390] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.393651] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-c30a526a-1afd-45f5-96cf-83a4dab8a3a4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.740441] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.740624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.740699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.740917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.741023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.741126] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab is going to be updated. [ 1107.768864] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.769052] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.769095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.769303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.769466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.778383] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: IN_PROGRESS for 2s [ 1107.813341] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.813877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.813877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.814044] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.814044] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.814688] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 1107.858573] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.858763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.858875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.859190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.859382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.871121] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 1108.172921] env[68109]: INFO networking_nsxv3.common.synchronization [req-86b1efe3-cb75-46d1-bbe7-c227ff2b40e5 req-27138f4c-f836-4d17-ad13-a099049d7738 service nova] Enqueued Resource ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c with Priority: HIGHEST for action security_group_rules [ 1108.173136] env[68109]: INFO networking_nsxv3.common.synchronization [req-86b1efe3-cb75-46d1-bbe7-c227ff2b40e5 req-27138f4c-f836-4d17-ad13-a099049d7738 service nova] Enqueued Resource ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c with Priority: HIGHEST for action security_group_members [ 1108.173286] env[68109]: INFO networking_nsxv3.common.synchronization [req-86b1efe3-cb75-46d1-bbe7-c227ff2b40e5 req-27138f4c-f836-4d17-ad13-a099049d7738 service nova] Enqueued Resource ID: c30a526a-1afd-45f5-96cf-83a4dab8a3a4 with Priority: HIGHEST for action port [ 1108.173519] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c with Priority: HIGHEST for action security_group_rules [ 1108.173653] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c with Priority: HIGHEST for action security_group_members [ 1108.173760] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c30a526a-1afd-45f5-96cf-83a4dab8a3a4 with Priority: HIGHEST for action port [ 1108.178024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.178024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.178024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.178024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.178024] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fef5c6c-c6aa-4088-93a6-194fafd50d0c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.178024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.178024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.178024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.178024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.178024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.178024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.178024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.178024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.178024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.178024] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fef5c6c-c6aa-4088-93a6-194fafd50d0c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.179743] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-c30a526a-1afd-45f5-96cf-83a4dab8a3a4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.181470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c30a526a-1afd-45f5-96cf-83a4dab8a3a4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.181470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c30a526a-1afd-45f5-96cf-83a4dab8a3a4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.181470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c30a526a-1afd-45f5-96cf-83a4dab8a3a4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.181470] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c30a526a-1afd-45f5-96cf-83a4dab8a3a4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.686036] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c30a526a-1afd-45f5-96cf-83a4dab8a3a4 with status ACTIVE [ 1108.686036] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.686036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.686036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.686036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.686036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.686036] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.686036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.686036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.686036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.686036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.686036] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.686036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.686036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.686036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.686036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.686036] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c30a526a-1afd-45f5-96cf-83a4dab8a3a4 is going to be updated. [ 1108.687439] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fef5c6c-c6aa-4088-93a6-194fafd50d0c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.688496] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.688773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.709537] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.709537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.709537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.709537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.709537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.709537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c30a526a-1afd-45f5-96cf-83a4dab8a3a4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.108535] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 in Status: SUCCESS [ 1109.108905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.190491] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fef5c6c-c6aa-4088-93a6-194fafd50d0c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.692598] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.692721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.693382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.693382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.693382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.693382] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c is going to be created. [ 1109.718124] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.718338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.718454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.718788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.719043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.729531] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c in Status: UNINITIALIZED for 2s [ 1109.788179] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: SUCCESS [ 1109.789216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.789216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.789216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.789472] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.789634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.789708] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.789912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.789997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.790515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.790515] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.881866] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 1109.882133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.882435] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.882722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.882929] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.883074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.883144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.883319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.883503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.883503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.883618] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.294518] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.294864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.294864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.295722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.295722] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.295722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.295722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.295722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.295722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.295722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.296142] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.296142] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.296142] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.296286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.296329] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.296667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.296667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.296667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.297054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.297054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.297054] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.386286] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.386503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.386619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.386903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.387265] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.387387] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.387451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.387644] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.387732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.387816] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.388686] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.388686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.388686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.388686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.388686] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.388686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.388686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.388940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.388968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.389081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.389178] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.799445] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 530264c4-f8bd-43b3-94f9-812deb7104ab: rpc.has_security_group_logging(os_id): False [ 1110.826373] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.826373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.826373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.826721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.826721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.828035] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.828035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.828035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.828035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.828035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.828035] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.828035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.828035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.828035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.828035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.828436] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.828541] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.828616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.828810] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.828933] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.829083] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab is going to be updated. [ 1110.885764] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.885962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.886015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.886222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.886368] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.892149] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7573caa0-9f71-40fd-82c3-03fa2ce88dbf: rpc.has_security_group_logging(os_id): False [ 1110.900675] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: IN_PROGRESS for 2s [ 1110.909124] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.909316] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.909406] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.909645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.909799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.910085] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.910206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.910279] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.910440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.910539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.910803] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.910908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.910973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.911138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.911218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.911418] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.912019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.912019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.912019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.912019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.912019] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 1110.968588] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.968743] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.968829] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.969059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.969211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.984109] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 1111.739773] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c in Status: SUCCESS [ 1111.739773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.739773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.740308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.740308] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.740308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.740308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.740537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.740582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.740773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.740773] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fef5c6c-c6aa-4088-93a6-194fafd50d0c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.242938] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fef5c6c-c6aa-4088-93a6-194fafd50d0c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.746921] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fef5c6c-c6aa-4088-93a6-194fafd50d0c: rpc.has_security_group_logging(os_id): False [ 1112.764221] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.764442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.764442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.764723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.764829] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.765094] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.765199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.765262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.765585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.765585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.765678] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c is going to be created. [ 1112.822196] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.822196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.822196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.823402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.823402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.831759] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c in Status: IN_PROGRESS for 2s [ 1112.922296] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: SUCCESS [ 1112.922296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.999607] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 1112.999607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.175705] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1113.175705] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1114.845763] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c in Status: SUCCESS [ 1114.846023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.319035] env[68109]: INFO networking_nsxv3.common.synchronization [req-65d02374-b5ce-46ee-8f53-8856069ac84f req-f37095b5-3389-4623-902b-67fddb83ad40 tempest-ServersNegativeTestJSON-2006371617 tempest-ServersNegativeTestJSON-2006371617-project-member] Enqueued Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_members [ 1115.319607] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGHEST for action security_group_members [ 1115.319944] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.320090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.320168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.320402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.320572] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.320689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.320744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.320917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.321013] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.321113] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.825272] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.825480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.825600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.825928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.826112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.826358] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.826468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.826566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.826810] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.826946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.827061] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b is going to be updated. [ 1115.853951] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.854209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.854209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.854449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.854624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.862886] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: IN_PROGRESS for 2s [ 1117.875956] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b in Status: SUCCESS [ 1117.876232] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b deletion is rescheduled due to dependency. [ 1117.876266] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.538814] env[68109]: INFO networking_nsxv3.common.synchronization [None req-7a5e11b7-048e-4b66-9371-948e81c80996 None None] Enqueued Resource ID: bbee4682-dcb9-45d3-a380-0c82f9aa24a3 with Priority: HIGHEST for action port [ 1118.538990] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbee4682-dcb9-45d3-a380-0c82f9aa24a3 with Priority: HIGHEST for action port [ 1118.539574] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbee4682-dcb9-45d3-a380-0c82f9aa24a3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.539703] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbee4682-dcb9-45d3-a380-0c82f9aa24a3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.539773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbee4682-dcb9-45d3-a380-0c82f9aa24a3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.540103] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbee4682-dcb9-45d3-a380-0c82f9aa24a3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.540155] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbee4682-dcb9-45d3-a380-0c82f9aa24a3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.042439] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bbee4682-dcb9-45d3-a380-0c82f9aa24a3 [ 1119.042721] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.042799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.043135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.043135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.043287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.043392] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bbee4682-dcb9-45d3-a380-0c82f9aa24a3 already deleted. [ 1119.043491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbee4682-dcb9-45d3-a380-0c82f9aa24a3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.857808] env[68109]: INFO networking_nsxv3.common.synchronization [req-181c47a7-de6c-4d9f-aac7-af3d306a161c req-8d5257b3-c22b-4052-81cd-b50105bd97a8 tempest-ServersAdminTestJSON-278829923 tempest-ServersAdminTestJSON-278829923-project-member] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1119.858547] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1119.859840] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.860007] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.860078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.861468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.861468] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.861468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.861468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.861468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.861468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.861468] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.363424] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.871886] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.917873] env[68109]: INFO networking_nsxv3.common.synchronization [None req-4c33d8ea-0e46-4203-b835-1a41e706ec4b None None] Enqueued Resource ID: f1b91495-0202-43b2-b2c1-c1e5a06d4c46 with Priority: HIGHEST for action port [ 1120.918382] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1b91495-0202-43b2-b2c1-c1e5a06d4c46 with Priority: HIGHEST for action port [ 1120.918973] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1b91495-0202-43b2-b2c1-c1e5a06d4c46 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.919940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1b91495-0202-43b2-b2c1-c1e5a06d4c46" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.920082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1b91495-0202-43b2-b2c1-c1e5a06d4c46" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.920590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1b91495-0202-43b2-b2c1-c1e5a06d4c46" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.920590] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1b91495-0202-43b2-b2c1-c1e5a06d4c46',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.374678] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.374999] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.374999] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.375103] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.375103] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.375822] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be updated. [ 1121.402226] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.402425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.402455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.402666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.403900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.416539] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1121.423511] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1b91495-0202-43b2-b2c1-c1e5a06d4c46 [ 1121.424302] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.424302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.424302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.424302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.424583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.424583] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1b91495-0202-43b2-b2c1-c1e5a06d4c46 already deleted. [ 1121.424583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1b91495-0202-43b2-b2c1-c1e5a06d4c46" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.428079] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1123.428391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.771207] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.771453] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.771618] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.771917] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.772261] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.772477] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.772632] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.772869] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.773038] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.773268] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.773416] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.773495] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.773609] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.773722] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.773831] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.773965] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.790930] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.791108] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1123.791243] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.791408] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-485" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.791682] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.791849] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.791972] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.792220] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.792362] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fe486e0-7c6b-4bfc-a56b-2e17bd922399',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.294317] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.294562] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.294732] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.295099] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.295271] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.295582] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.295748] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.295875] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.296121] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.296267] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.296561] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.296769] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.296882] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.297271] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.297542] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.297722] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 0fe486e0-7c6b-4bfc-a56b-2e17bd922399 is going to be updated. [ 1124.323581] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.324082] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.324228] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.324527] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.324819] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.325284] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.418816] env[68109]: INFO networking_nsxv3.common.synchronization [req-84c5fd8f-03fb-4d7d-a8c4-cdfb521959ed req-00e77d19-478e-41ba-8d67-46c99536cc74 tempest-ServerRescueTestJSONUnderV235-1887510182 tempest-ServerRescueTestJSONUnderV235-1887510182-project-member] Enqueued Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_members [ 1124.419490] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_members [ 1124.419813] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-95643695-b4c0-4631-8571-eb7422297d00 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.420258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.420258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.423228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.423228] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.423228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.423228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.423228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.423228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.423228] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.888224] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.888634] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-434" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.888634] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-434" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.888944] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-434" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.889367] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.889630] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.889849] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.890253] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.890500] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.890872] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.891016] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1124.891179] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1124.891334] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1124.891480] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.891611] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1124.891781] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1124.909342] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1124.909509] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1124.909606] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1124.909813] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-434" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.910198] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.910405] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.910554] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.910902] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.911064] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a36ab031-b90b-40ef-a332-b6e1f23f6fbe',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.923852] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.924020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.924093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.924303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.924392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.924575] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.924678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.924825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.924909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.924985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.925162] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95643695-b4c0-4631-8571-eb7422297d00 already deleted. [ 1124.925250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.042376] env[68109]: INFO networking_nsxv3.common.synchronization [req-49f5fdd9-7bee-4cc2-a2c0-01827f0bcbb6 req-c721994c-f27b-4eb0-8308-6d00fea90421 service nova] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_rules [ 1125.042577] env[68109]: INFO networking_nsxv3.common.synchronization [req-49f5fdd9-7bee-4cc2-a2c0-01827f0bcbb6 req-c721994c-f27b-4eb0-8308-6d00fea90421 service nova] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1125.042716] env[68109]: INFO networking_nsxv3.common.synchronization [req-49f5fdd9-7bee-4cc2-a2c0-01827f0bcbb6 req-c721994c-f27b-4eb0-8308-6d00fea90421 service nova] Enqueued Resource ID: 0fe486e0-7c6b-4bfc-a56b-2e17bd922399 with Priority: HIGHEST for action port [ 1125.042954] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_rules [ 1125.043100] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1125.043201] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe486e0-7c6b-4bfc-a56b-2e17bd922399 with Priority: HIGHEST for action port [ 1125.043750] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.043868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.043940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.044520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.044608] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.045772] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.047663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.047663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.047663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.047663] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.047663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.047663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.047663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.047663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.047663] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.047663] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.047663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.047989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.047989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.047989] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fe486e0-7c6b-4bfc-a56b-2e17bd922399',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.413471] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.413835] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.413968] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.414356] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.414599] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.414847] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port a36ab031-b90b-40ef-a332-b6e1f23f6fbe not found, creating... [ 1125.415193] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.415364] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.415488] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.415801] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.415874] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.416181] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.416341] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.416469] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.416704] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.416880] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.417077] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: a36ab031-b90b-40ef-a332-b6e1f23f6fbe is going to be created. [ 1125.436215] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.436367] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.436515] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.436900] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.437225] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.437436] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.550800] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.550800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.550800] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.551966] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0fe486e0-7c6b-4bfc-a56b-2e17bd922399 with status ACTIVE [ 1125.552161] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.552276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.552343] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.552545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.552640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.552809] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.552908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.552972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.553146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.553225] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.553400] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.553576] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.553576] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.553683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.553757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.553842] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0fe486e0-7c6b-4bfc-a56b-2e17bd922399 is going to be updated. [ 1125.573971] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.574146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.574188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.574355] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.574484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.574644] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fe486e0-7c6b-4bfc-a56b-2e17bd922399" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.053195] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.269023] env[68109]: INFO networking_nsxv3.common.synchronization [req-84c5fd8f-03fb-4d7d-a8c4-cdfb521959ed req-a542c51d-b69d-464d-a153-136835fa18f3 service nova] Enqueued Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_rules [ 1126.269023] env[68109]: INFO networking_nsxv3.common.synchronization [req-84c5fd8f-03fb-4d7d-a8c4-cdfb521959ed req-a542c51d-b69d-464d-a153-136835fa18f3 service nova] Enqueued Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_members [ 1126.269023] env[68109]: INFO networking_nsxv3.common.synchronization [req-84c5fd8f-03fb-4d7d-a8c4-cdfb521959ed req-a542c51d-b69d-464d-a153-136835fa18f3 service nova] Enqueued Resource ID: a36ab031-b90b-40ef-a332-b6e1f23f6fbe with Priority: HIGHEST for action port [ 1126.269023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_rules [ 1126.269023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_members [ 1126.269023] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a36ab031-b90b-40ef-a332-b6e1f23f6fbe with Priority: HIGHEST for action port [ 1126.269730] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95643695-b4c0-4631-8571-eb7422297d00 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.270091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.270262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.270692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.270874] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.271854] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-95643695-b4c0-4631-8571-eb7422297d00 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.272108] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.272262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.272530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.272771] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.273040] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.273188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.274025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.274025] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.274025] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.274744] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.274989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.275172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.275409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.276913] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a36ab031-b90b-40ef-a332-b6e1f23f6fbe',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.557271] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.557612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.558949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.560177] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.560290] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.560423] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 1126.586382] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.586597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.586597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.586825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.586976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.594934] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 1126.777194] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.778811] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-95643695-b4c0-4631-8571-eb7422297d00 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.778811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.779223] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a36ab031-b90b-40ef-a332-b6e1f23f6fbe with status ACTIVE [ 1126.779451] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.779662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.779717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.779950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.780103] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.780371] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.780514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.780600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.780823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.780927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.781187] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.781336] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.781430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.781628] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.781734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.781852] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a36ab031-b90b-40ef-a332-b6e1f23f6fbe is going to be updated. [ 1126.802350] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.802624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.802624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.802884] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.803485] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.803485] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.280473] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.785064] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.785064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.785064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.785064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.785064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.785064] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95643695-b4c0-4631-8571-eb7422297d00 is going to be created. [ 1127.809359] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.809477] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.809545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.809719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.809872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.820331] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: UNINITIALIZED for 2s [ 1128.340441] env[68109]: INFO networking_nsxv3.common.synchronization [req-558067bd-ef09-4dd3-b3b1-3b06d6111dd4 req-9d06155d-1f57-4944-bd06-29781673448d tempest-ServersAdminTestJSON-278829923 tempest-ServersAdminTestJSON-278829923-project-member] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1128.340441] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1128.340441] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.340441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.340441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.340441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.340441] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.340441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.340441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.340935] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.340935] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.341051] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.605419] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 4s [ 1128.645307] env[68109]: INFO networking_nsxv3.common.synchronization [req-9f016aa0-04b5-428f-8dc2-02f3133fd9ac req-530d97bf-24a8-48da-91d3-c2b0674b490c tempest-ServerActionsTestOtherB-1748290489 tempest-ServerActionsTestOtherB-1748290489-project-member] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 1128.645805] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 1128.646334] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.646495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.646588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.646869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.647073] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.647207] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.647304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.647494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.647618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.647846] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.842817] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.151102] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.151102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.151102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.151102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.151102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.151102] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.151494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.151494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.151494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.151494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.151494] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be updated. [ 1129.180540] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.180772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.180772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.180968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.181127] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.188725] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: IN_PROGRESS for 2s [ 1129.345094] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.829050] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: SUCCESS [ 1129.829327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.829496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.829705] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.829895] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.830030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.830099] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.830254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.830333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.830419] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.830510] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.847820] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.847965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.848068] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.848257] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.848341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.848435] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be updated. [ 1129.875124] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.875294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.875294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.875467] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.875612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.883123] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1130.333361] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-95643695-b4c0-4631-8571-eb7422297d00 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.333637] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.333770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.334110] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.334367] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.334518] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.334599] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.334866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.335015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.335178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.335385] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-95643695-b4c0-4631-8571-eb7422297d00 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.335510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.335595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.335807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.336028] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.336172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.336268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.336482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.336599] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.336717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.336852] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.614593] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 1130.614940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.614940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.615077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.615286] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.615483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.615483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.615630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.615712] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.615798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.615889] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.840234] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95643695-b4c0-4631-8571-eb7422297d00: rpc.has_security_group_logging(os_id): False [ 1130.949155] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.949415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.949415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.949718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.949859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.950140] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.950303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.950418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.950640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.950765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.951096] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.951217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.951300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.951499] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.951620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.951872] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.952035] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.952158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.952349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.952469] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.952609] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95643695-b4c0-4631-8571-eb7422297d00 is going to be created. [ 1131.009229] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.009474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.009474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.009658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.009842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.023878] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: IN_PROGRESS for 2s [ 1131.117921] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.118176] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.118266] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.118585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.118689] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.118792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.118997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.119251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.119355] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.119458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.119621] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.119724] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.119787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.119934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.120137] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.120262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.120351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.120509] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.120591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.120678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.120772] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.198946] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 1131.199135] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 deletion is rescheduled due to dependency. [ 1131.199279] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.623555] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7573caa0-9f71-40fd-82c3-03fa2ce88dbf: rpc.has_security_group_logging(os_id): False [ 1131.645234] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.645376] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.645483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.645645] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.645756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.645946] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.646059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.646120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.646280] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.646352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.646542] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.646634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.646690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.646984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.647134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.647353] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.647459] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.647523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.647677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.647788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.647882] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 1131.722886] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.723224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.723224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.723383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.723520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.739466] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 1131.892707] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1131.892930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.798857] env[68109]: INFO networking_nsxv3.common.synchronization [req-1060f0b5-2c13-4dcc-bf36-f2e94f16d53f req-9757465a-81ec-47f1-ad16-077ec0fd9d32 tempest-ServerRescueTestJSON-1286138287 tempest-ServerRescueTestJSON-1286138287-project-member] Enqueued Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_members [ 1132.799508] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_members [ 1132.799872] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.800284] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.804030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.804030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.804030] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.804030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.804030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.804030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.804030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.804030] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.839780] env[68109]: INFO networking_nsxv3.common.synchronization [req-eea3ddc0-ad22-433a-8024-5a689980ebb8 req-fffa901b-4743-4b03-8174-7370f30666db tempest-ImagesOneServerNegativeTestJSON-1955885897 tempest-ImagesOneServerNegativeTestJSON-1955885897-project-member] Enqueued Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1132.840648] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1132.841264] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.841264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.841264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.841264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.841478] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.842138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.842138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.842138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.842138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.842138] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.035756] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: SUCCESS [ 1133.035923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.306412] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.345481] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.345641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.345713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.345928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.346028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.346214] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.346305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.346363] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.346509] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.346578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.346660] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab is going to be updated. [ 1133.370674] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.370883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.370883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.371098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.371268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.378867] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: IN_PROGRESS for 2s [ 1133.757928] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 1133.757928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.809540] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.312165] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.312165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.312165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.312165] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.312358] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.312358] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a565832-732a-4ead-8829-a1e204cdbc42 is going to be updated. [ 1134.338842] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.339009] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.339065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.339272] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.339416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.347484] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a565832-732a-4ead-8829-a1e204cdbc42 in Status: IN_PROGRESS for 2s [ 1135.048651] env[68109]: INFO networking_nsxv3.common.synchronization [req-4ff9c779-c826-477f-83f5-a5eb1876b5dc req-ee4573c1-7bec-461c-8486-7dd21b938b7b tempest-ServersAdminTestJSON-278829923 tempest-ServersAdminTestJSON-278829923-project-member] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1135.049199] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1135.049510] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.049647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.049817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.050047] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.050215] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.050310] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.050375] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.050522] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.050910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.050910] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.388152] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: SUCCESS [ 1135.388349] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab deletion is rescheduled due to dependency. [ 1135.388462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.553376] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.055651] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.356554] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a565832-732a-4ead-8829-a1e204cdbc42 in Status: SUCCESS [ 1136.356554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.558551] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.558724] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.558768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.558991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.559101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.559246] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be updated. [ 1136.584489] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.584663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.584724] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.584914] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.585071] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.593047] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1136.931151] env[68109]: INFO networking_nsxv3.common.synchronization [req-1ee7a7dd-7f0f-498b-b85c-d784310ce13d req-4a82af68-03b6-4757-b439-78cf88c120a5 tempest-ServerActionsTestOtherB-1748290489 tempest-ServerActionsTestOtherB-1748290489-project-member] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 1136.931729] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 1136.932079] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.932239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.932323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.932545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.932705] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.932807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.932869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.933033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.933128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.933209] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.192070] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-535 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.192070] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.192070] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.192070] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.192498] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.192498] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.192498] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.192715] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.192859] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.193086] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1137.193207] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1137.193321] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1137.193434] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1137.193547] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1137.193656] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1137.193793] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1137.213271] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1137.213432] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1137.213574] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1137.213742] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.214033] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-ab63e809-e79e-45cf-833f-d475b23b9e97 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.214200] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.214324] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.214617] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.214786] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab63e809-e79e-45cf-833f-d475b23b9e97',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.435872] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.436081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.436127] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.436374] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.436492] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.436701] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.436802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.436899] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.437089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.437170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.437258] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be updated. [ 1137.462733] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.462919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.462959] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.463145] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.463279] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.472396] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: IN_PROGRESS for 2s [ 1137.716559] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.716795] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.716979] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.717281] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.717438] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.717598] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port ab63e809-e79e-45cf-833f-d475b23b9e97 not found, creating... [ 1137.717865] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.718056] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.718183] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.718433] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.718592] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.718876] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.719053] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.719179] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.719388] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.719525] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.719667] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: ab63e809-e79e-45cf-833f-d475b23b9e97 is going to be created. [ 1137.741311] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.741520] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.741650] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.741908] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.742154] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.742398] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.432017] env[68109]: INFO networking_nsxv3.common.synchronization [req-1ee7a7dd-7f0f-498b-b85c-d784310ce13d req-cd3e8b01-4116-441b-bc09-344cae1e6692 service nova] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_rules [ 1138.432353] env[68109]: INFO networking_nsxv3.common.synchronization [req-1ee7a7dd-7f0f-498b-b85c-d784310ce13d req-cd3e8b01-4116-441b-bc09-344cae1e6692 service nova] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 1138.432353] env[68109]: INFO networking_nsxv3.common.synchronization [req-1ee7a7dd-7f0f-498b-b85c-d784310ce13d req-cd3e8b01-4116-441b-bc09-344cae1e6692 service nova] Enqueued Resource ID: ab63e809-e79e-45cf-833f-d475b23b9e97 with Priority: HIGHEST for action port [ 1138.432602] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_rules [ 1138.432772] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 1138.432843] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab63e809-e79e-45cf-833f-d475b23b9e97 with Priority: HIGHEST for action port [ 1138.433701] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.433831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.433970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.434135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.434221] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.435073] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.435174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.435386] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab63e809-e79e-45cf-833f-d475b23b9e97 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.435507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.435575] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.435763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.437418] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab63e809-e79e-45cf-833f-d475b23b9e97',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.602073] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 4s [ 1138.940517] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.940710] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.940968] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab63e809-e79e-45cf-833f-d475b23b9e97 with status ACTIVE [ 1138.941288] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.941448] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.941520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.941732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.941822] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.942010] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.942146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.942218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.942381] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.942484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.942635] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.942731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.942792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.942931] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.943013] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.943111] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab63e809-e79e-45cf-833f-d475b23b9e97 is going to be updated. [ 1138.962900] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.963631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.963631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.963631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.963631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.963631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.482738] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 1139.483063] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 deletion is rescheduled due to dependency. [ 1139.483063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.483527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.483744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.483922] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.484053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.484124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.484268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.484349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.484440] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.986675] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.489540] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.612101] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1140.612427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.992623] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.992623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.992757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.992865] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.992941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.993056] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be updated. [ 1141.019740] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.019881] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.019917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.020149] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.020301] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.028431] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: IN_PROGRESS for 2s [ 1141.480294] env[68109]: INFO networking_nsxv3.common.synchronization [req-67f437ae-434b-47dd-b992-c3a7165eb4af req-fc834f0f-fb2d-4cf3-aac0-e5e6d2222466 tempest-ServerRescueTestJSON-1286138287 tempest-ServerRescueTestJSON-1286138287-project-member] Enqueued Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_members [ 1141.480822] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGHEST for action security_group_members [ 1141.481191] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.481307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.481307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.481527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.481676] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.481779] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.481836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.481995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.482817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.482817] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.817824] env[68109]: INFO networking_nsxv3.common.synchronization [req-e9345f54-2ec0-401b-9275-3638ff383ec9 req-e3338d58-8d7c-44c4-a4fd-c6b91e0e780f tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_members [ 1141.818428] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_members [ 1141.818731] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e6efd-f18b-488b-b84c-5caae41cc733 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.818856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.818927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.819147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.819339] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.819840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.819840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.819840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.819840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.819959] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.988057] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.988057] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.988057] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.988057] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.988333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.988333] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.988414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.988514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.988585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.988660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.988747] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a565832-732a-4ead-8829-a1e204cdbc42 is going to be updated. [ 1142.017385] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.017385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.017385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.017385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.017385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.023356] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a565832-732a-4ead-8829-a1e204cdbc42 in Status: IN_PROGRESS for 2s [ 1142.322596] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.824955] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.038310] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 1143.038572] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.038761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.039027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.039249] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.039390] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.039456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.039616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.039696] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.039784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.039878] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.327458] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.327740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.327866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.328180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.328315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.328439] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e6efd-f18b-488b-b84c-5caae41cc733 is going to be updated. [ 1143.355098] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.355282] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.355329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.355509] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.355682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.365188] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e6efd-f18b-488b-b84c-5caae41cc733 in Status: IN_PROGRESS for 2s [ 1143.544066] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.032354] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a565832-732a-4ead-8829-a1e204cdbc42 in Status: SUCCESS [ 1144.032614] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a565832-732a-4ead-8829-a1e204cdbc42 deletion is rescheduled due to dependency. [ 1144.032665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.046117] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 841d58e8-0316-41e3-a855-66ac66e6d9f4: rpc.has_security_group_logging(os_id): False [ 1144.062402] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.062539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.062609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.062809] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.062900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.063149] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.063267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.063357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.063517] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.063595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.063682] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be updated. [ 1144.116926] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.117068] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.117150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.117357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.118023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.129790] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: IN_PROGRESS for 2s [ 1144.188850] env[68109]: INFO networking_nsxv3.common.synchronization [req-9f0bc102-74ea-4032-90a8-b49e172628e1 req-e6b59579-61d5-4bfb-a43e-5e3bf6331f2b tempest-ServerRescueTestJSONUnderV235-1887510182 tempest-ServerRescueTestJSONUnderV235-1887510182-project-member] Enqueued Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_members [ 1144.188850] env[68109]: INFO networking_nsxv3.common.synchronization [req-9f0bc102-74ea-4032-90a8-b49e172628e1 req-e6b59579-61d5-4bfb-a43e-5e3bf6331f2b tempest-ServerRescueTestJSONUnderV235-1887510182 tempest-ServerRescueTestJSONUnderV235-1887510182-project-member] Enqueued Resource ID: 1e59ee72-3197-457a-849a-50911dcc10dc with Priority: HIGHEST for action security_group_members [ 1144.190377] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_members [ 1144.190377] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e59ee72-3197-457a-849a-50911dcc10dc with Priority: HIGHEST for action security_group_members [ 1144.190377] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-95643695-b4c0-4631-8571-eb7422297d00 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.190377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.190377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.190377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.190377] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.190377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.190377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.190735] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.190735] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.190735] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.191445] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e59ee72-3197-457a-849a-50911dcc10dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.191605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.191635] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.191817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.191990] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.192328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.192328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.192328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.192457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.192457] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e59ee72-3197-457a-849a-50911dcc10dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.231413] env[68109]: INFO networking_nsxv3.common.synchronization [req-9f0bc102-74ea-4032-90a8-b49e172628e1 req-e6b59579-61d5-4bfb-a43e-5e3bf6331f2b tempest-ServerRescueTestJSONUnderV235-1887510182 tempest-ServerRescueTestJSONUnderV235-1887510182-project-member] Enqueued Resource ID: 1e59ee72-3197-457a-849a-50911dcc10dc with Priority: HIGHEST for action security_group_rules [ 1144.231413] env[68109]: INFO networking_nsxv3.common.synchronization [req-9f0bc102-74ea-4032-90a8-b49e172628e1 req-e6b59579-61d5-4bfb-a43e-5e3bf6331f2b tempest-ServerRescueTestJSONUnderV235-1887510182 tempest-ServerRescueTestJSONUnderV235-1887510182-project-member] Enqueued Resource ID: 1e59ee72-3197-457a-849a-50911dcc10dc with Priority: HIGHEST for action security_group_members [ 1144.231413] env[68109]: INFO networking_nsxv3.common.synchronization [req-9f0bc102-74ea-4032-90a8-b49e172628e1 req-e6b59579-61d5-4bfb-a43e-5e3bf6331f2b tempest-ServerRescueTestJSONUnderV235-1887510182 tempest-ServerRescueTestJSONUnderV235-1887510182-project-member] Enqueued Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_rules [ 1144.231413] env[68109]: INFO networking_nsxv3.common.synchronization [req-9f0bc102-74ea-4032-90a8-b49e172628e1 req-e6b59579-61d5-4bfb-a43e-5e3bf6331f2b tempest-ServerRescueTestJSONUnderV235-1887510182 tempest-ServerRescueTestJSONUnderV235-1887510182-project-member] Enqueued Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_members [ 1144.231413] env[68109]: INFO networking_nsxv3.common.synchronization [req-9f0bc102-74ea-4032-90a8-b49e172628e1 req-e6b59579-61d5-4bfb-a43e-5e3bf6331f2b tempest-ServerRescueTestJSONUnderV235-1887510182 tempest-ServerRescueTestJSONUnderV235-1887510182-project-member] Enqueued Resource ID: a36ab031-b90b-40ef-a332-b6e1f23f6fbe with Priority: HIGHEST for action port [ 1144.231413] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e59ee72-3197-457a-849a-50911dcc10dc with Priority: HIGHEST for action security_group_rules [ 1144.231413] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_rules [ 1144.231413] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a36ab031-b90b-40ef-a332-b6e1f23f6fbe with Priority: HIGHEST for action port [ 1144.231413] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e59ee72-3197-457a-849a-50911dcc10dc with Priority: HIGHEST for action security_group_members [ 1144.231413] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_members [ 1144.231413] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e59ee72-3197-457a-849a-50911dcc10dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.231413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.231413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.231413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.231413] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e59ee72-3197-457a-849a-50911dcc10dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.232017] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95643695-b4c0-4631-8571-eb7422297d00 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.232017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.232017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.232017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.232017] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.232711] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.232834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.232898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.233028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.235821] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a36ab031-b90b-40ef-a332-b6e1f23f6fbe',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.235821] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e59ee72-3197-457a-849a-50911dcc10dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.235821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.235821] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-95643695-b4c0-4631-8571-eb7422297d00 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.235821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.533213] env[68109]: INFO networking_nsxv3.common.synchronization [req-6070b181-9801-4235-b4b2-97883d411039 req-caffb736-0af1-429b-b986-33339c6cd9f4 tempest-ServerRescueTestJSONUnderV235-1887510182 tempest-ServerRescueTestJSONUnderV235-1887510182-project-member] Enqueued Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_members [ 1144.533462] env[68109]: INFO networking_nsxv3.common.synchronization [req-6070b181-9801-4235-b4b2-97883d411039 req-caffb736-0af1-429b-b986-33339c6cd9f4 tempest-ServerRescueTestJSONUnderV235-1887510182 tempest-ServerRescueTestJSONUnderV235-1887510182-project-member] Enqueued Resource ID: 1e59ee72-3197-457a-849a-50911dcc10dc with Priority: HIGHEST for action security_group_members [ 1144.534066] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_members [ 1144.534170] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e59ee72-3197-457a-849a-50911dcc10dc with Priority: HIGHEST for action security_group_members [ 1144.534487] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-95643695-b4c0-4631-8571-eb7422297d00 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.534614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.534861] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e59ee72-3197-457a-849a-50911dcc10dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.534977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.572068] env[68109]: INFO networking_nsxv3.common.synchronization [req-6070b181-9801-4235-b4b2-97883d411039 req-caffb736-0af1-429b-b986-33339c6cd9f4 tempest-ServerRescueTestJSONUnderV235-1887510182 tempest-ServerRescueTestJSONUnderV235-1887510182-project-member] Enqueued Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_rules [ 1144.572335] env[68109]: INFO networking_nsxv3.common.synchronization [req-6070b181-9801-4235-b4b2-97883d411039 req-caffb736-0af1-429b-b986-33339c6cd9f4 tempest-ServerRescueTestJSONUnderV235-1887510182 tempest-ServerRescueTestJSONUnderV235-1887510182-project-member] Enqueued Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_members [ 1144.572583] env[68109]: INFO networking_nsxv3.common.synchronization [req-6070b181-9801-4235-b4b2-97883d411039 req-caffb736-0af1-429b-b986-33339c6cd9f4 tempest-ServerRescueTestJSONUnderV235-1887510182 tempest-ServerRescueTestJSONUnderV235-1887510182-project-member] Enqueued Resource ID: a36ab031-b90b-40ef-a332-b6e1f23f6fbe with Priority: HIGHEST for action port [ 1144.573076] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_rules [ 1144.573215] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_members [ 1144.573311] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a36ab031-b90b-40ef-a332-b6e1f23f6fbe with Priority: HIGHEST for action port [ 1144.573609] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-95643695-b4c0-4631-8571-eb7422297d00 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.573711] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.573918] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-95643695-b4c0-4631-8571-eb7422297d00 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.574007] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.574490] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.574583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.694029] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.695724] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e59ee72-3197-457a-849a-50911dcc10dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.735517] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e59ee72-3197-457a-849a-50911dcc10dc taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.735743] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.735951] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-95643695-b4c0-4631-8571-eb7422297d00 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.736064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.736252] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a36ab031-b90b-40ef-a332-b6e1f23f6fbe with status ACTIVE [ 1144.736433] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.736570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.736649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.736904] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.737085] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.737294] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.737394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.737454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.737632] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.737714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.737891] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.737984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.738085] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.738240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.738315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.738400] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a36ab031-b90b-40ef-a332-b6e1f23f6fbe is going to be updated. [ 1144.757489] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.757620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.757693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.757897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.758076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.758213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.758368] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.758529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.758612] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a36ab031-b90b-40ef-a332-b6e1f23f6fbe',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.145094] env[68109]: INFO networking_nsxv3.common.synchronization [req-8caa9d14-79cd-40cc-8149-95189c630440 req-222be742-e7f0-4302-959d-16148c0ddf6d tempest-ServersAdminTestJSON-278829923 tempest-ServersAdminTestJSON-278829923-project-member] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1145.145640] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGHEST for action security_group_members [ 1145.146425] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.146425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.146425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.146425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.146686] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.146686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.146686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.146783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.146875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.146980] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.196496] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.197436] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e59ee72-3197-457a-849a-50911dcc10dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.260686] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a36ab031-b90b-40ef-a332-b6e1f23f6fbe with status ACTIVE [ 1145.260937] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.261100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.261171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.261383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.261475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.261651] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.261747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.261804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.261958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.262048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.262232] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.262322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.262388] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.262515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.262588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.262672] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a36ab031-b90b-40ef-a332-b6e1f23f6fbe is going to be updated. [ 1145.287256] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.287434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.287434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.287624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.287756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.287909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a36ab031-b90b-40ef-a332-b6e1f23f6fbe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.386390] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e6efd-f18b-488b-b84c-5caae41cc733 in Status: SUCCESS [ 1145.388596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.653031] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.653031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.653031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.653031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.653031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.653031] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.653031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.653031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.653031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.653031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.653031] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be updated. [ 1145.688209] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.688209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.688209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.688209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.688209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.701019] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: IN_PROGRESS for 2s [ 1145.701019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.701019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.701019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.701019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.701019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.701019] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95643695-b4c0-4631-8571-eb7422297d00 is going to be updated. [ 1145.702633] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.702763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.702818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.702991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.703086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.703174] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e59ee72-3197-457a-849a-50911dcc10dc is going to be created. [ 1145.704777] env[68109]: INFO networking_nsxv3.common.synchronization [req-41959a9c-6329-4525-ac6f-577a2fcfad70 req-01b513f2-7242-4f23-a0eb-0233a4461d44 tempest-ImagesOneServerNegativeTestJSON-1955885897 tempest-ImagesOneServerNegativeTestJSON-1955885897-project-member] Enqueued Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1145.706575] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1145.707264] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.707441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.707925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.708160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.708351] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.708522] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.708522] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.708720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.708914] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.708914] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.724063] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.724204] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.724284] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.724494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.725114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.728048] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.728331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.728430] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.728647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.728794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.742567] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: IN_PROGRESS for 2s [ 1145.743651] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e59ee72-3197-457a-849a-50911dcc10dc in Status: UNINITIALIZED for 2s [ 1145.991826] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-137 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.991998] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-137" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.992140] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-137" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.992407] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-137" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.992667] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.992820] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.992937] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.993328] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.993484] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.993702] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.993821] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.993934] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.994332] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.994332] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.994332] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.994469] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.013215] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.013337] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1146.013790] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.013790] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-137" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.013909] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-b29e8169-6801-4986-b7a2-22ae39222fc7 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.014083] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-b29e8169-6801-4986-b7a2-22ae39222fc7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.014211] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-b29e8169-6801-4986-b7a2-22ae39222fc7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.014496] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-b29e8169-6801-4986-b7a2-22ae39222fc7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.014632] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b29e8169-6801-4986-b7a2-22ae39222fc7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.143785] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 1146.143785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.211774] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.212308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.212308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.212308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.212479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.212576] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.212675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.212736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.212890] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.212964] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.213070] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab is going to be updated. [ 1146.237258] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.237425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.237512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.237722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.237861] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.246182] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: IN_PROGRESS for 2s [ 1146.521212] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.521212] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.521212] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.521212] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.521212] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.521212] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port b29e8169-6801-4986-b7a2-22ae39222fc7 not found, creating... [ 1146.521212] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.521212] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.521212] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.521212] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.521212] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.521612] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.521612] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.521612] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.521612] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.521612] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.521612] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: b29e8169-6801-4986-b7a2-22ae39222fc7 is going to be created. [ 1146.550962] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.550962] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.550962] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.550962] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.550962] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.550962] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-b29e8169-6801-4986-b7a2-22ae39222fc7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.465827] env[68109]: INFO networking_nsxv3.common.synchronization [req-41959a9c-6329-4525-ac6f-577a2fcfad70 req-651c2b7c-6e91-492b-8a43-84de6aa6756d service nova] Enqueued Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_rules [ 1147.466117] env[68109]: INFO networking_nsxv3.common.synchronization [req-41959a9c-6329-4525-ac6f-577a2fcfad70 req-651c2b7c-6e91-492b-8a43-84de6aa6756d service nova] Enqueued Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1147.466211] env[68109]: INFO networking_nsxv3.common.synchronization [req-41959a9c-6329-4525-ac6f-577a2fcfad70 req-651c2b7c-6e91-492b-8a43-84de6aa6756d service nova] Enqueued Resource ID: b29e8169-6801-4986-b7a2-22ae39222fc7 with Priority: HIGHEST for action port [ 1147.466462] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_rules [ 1147.466691] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1147.466691] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b29e8169-6801-4986-b7a2-22ae39222fc7 with Priority: HIGHEST for action port [ 1147.468292] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.468292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.468292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.468456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.468561] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.469476] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.469559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.469736] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-b29e8169-6801-4986-b7a2-22ae39222fc7 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.469853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b29e8169-6801-4986-b7a2-22ae39222fc7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.469925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b29e8169-6801-4986-b7a2-22ae39222fc7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.470120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b29e8169-6801-4986-b7a2-22ae39222fc7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.470196] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b29e8169-6801-4986-b7a2-22ae39222fc7',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.708314] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 in Status: SUCCESS [ 1147.708861] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 deletion is rescheduled due to dependency. [ 1147.708989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.751426] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e59ee72-3197-457a-849a-50911dcc10dc in Status: SUCCESS [ 1147.751753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.751938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.752217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.752408] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.752528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.752647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.752825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.752909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.753014] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e59ee72-3197-457a-849a-50911dcc10dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.754396] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: SUCCESS [ 1147.754662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.754851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.755051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.755212] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.755330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.755406] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.755601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.755700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.755811] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.975562] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.975562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.975562] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b29e8169-6801-4986-b7a2-22ae39222fc7 with status ACTIVE [ 1147.975562] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.975844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.975844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.975844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.975995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.976116] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.976215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.976334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.976440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.976518] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.976700] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.976792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.976844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.976992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.977096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.977187] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b29e8169-6801-4986-b7a2-22ae39222fc7 is going to be updated. [ 1148.001428] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.001657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.001657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.001854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.001996] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.002176] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b29e8169-6801-4986-b7a2-22ae39222fc7" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.256504] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: SUCCESS [ 1148.256735] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab deletion is rescheduled due to dependency. [ 1148.256875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.257414] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.257552] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.257628] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.257799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.257876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.258087] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.258203] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.258270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.258396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.258531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.258595] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e59ee72-3197-457a-849a-50911dcc10dc is going to be deleted. [ 1148.259440] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.260234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.260406] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.260557] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.260654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.260715] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.260842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.260912] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.260996] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.289735] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.289885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.289951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.290156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.290259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.290362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.290780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.290951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.291124] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.291231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.291292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.291428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.291502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.291594] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e59ee72-3197-457a-849a-50911dcc10dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.763307] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.767373] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.794600] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.794600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.794600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.794600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.794600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.794880] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.794880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.794880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.795019] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.795058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.795227] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e59ee72-3197-457a-849a-50911dcc10dc already deleted. [ 1148.795227] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.796294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.796294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.796294] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.796294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.796294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.796294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.796294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.796589] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e59ee72-3197-457a-849a-50911dcc10dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.265816] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.265980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.266089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.266390] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.266551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.266685] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95643695-b4c0-4631-8571-eb7422297d00 is going to be updated. [ 1149.270559] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.296085] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.296295] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.296407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.296685] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.296902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.298911] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.299070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.299148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.299338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.299434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.299648] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.299754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.299832] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.299985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.300077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.300649] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e59ee72-3197-457a-849a-50911dcc10dc already deleted. [ 1149.300649] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.300649] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e59ee72-3197-457a-849a-50911dcc10dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.309049] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: IN_PROGRESS for 2s [ 1149.772616] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.772945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.772945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.773127] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.773235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.773332] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab is going to be updated. [ 1149.799478] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.799610] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.799686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.799897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.800120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.802554] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e59ee72-3197-457a-849a-50911dcc10dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.818330] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: IN_PROGRESS for 2s [ 1149.862222] env[68109]: INFO networking_nsxv3.common.synchronization [req-b305d502-e529-4714-8c5d-93324be5a0e8 req-8e022133-0907-4d72-878b-372c86bb5ca3 tempest-ServerRescueTestJSONUnderV235-1887510182 tempest-ServerRescueTestJSONUnderV235-1887510182-project-member] Enqueued Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_members [ 1149.862735] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95643695-b4c0-4631-8571-eb7422297d00 with Priority: HIGHEST for action security_group_members [ 1149.863039] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-95643695-b4c0-4631-8571-eb7422297d00 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.863148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.304974] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e59ee72-3197-457a-849a-50911dcc10dc: rpc.has_security_group_logging(os_id): False [ 1150.322918] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.323075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.323075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.323398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.323524] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.323786] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.323916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.323987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.324335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.324403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.324555] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e59ee72-3197-457a-849a-50911dcc10dc is going to be created. [ 1150.338260] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1e59ee72-3197-457a-849a-50911dcc10dc], does not exist path=[/infra/domains/default/groups/1e59ee72-3197-457a-849a-50911dcc10dc]."\n}' [ 1150.338402] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e59ee72-3197-457a-849a-50911dcc10dc failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1e59ee72-3197-457a-849a-50911dcc10dc [ 1150.338492] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1150.368250] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.368402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.368455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.368667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.369722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.369988] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.370105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.370170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.370326] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.370402] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.370602] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.370692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.370757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.370887] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.370958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.371055] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e59ee72-3197-457a-849a-50911dcc10dc is going to be created. [ 1150.394209] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/1e59ee72-3197-457a-849a-50911dcc10dc], does not exist path=[/infra/domains/default/groups/1e59ee72-3197-457a-849a-50911dcc10dc]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1e59ee72-3197-457a-849a-50911dcc10dc [ 1150.394361] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e59ee72-3197-457a-849a-50911dcc10dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.394559] env[68109]: Traceback (most recent call last): [ 1150.394595] env[68109]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1150.394595] env[68109]: return func(*args, **kwargs) [ 1150.394595] env[68109]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1150.394595] env[68109]: res.raise_for_status() [ 1150.394595] env[68109]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1150.394595] env[68109]: raise HTTPError(http_error_msg, response=self) [ 1150.394595] env[68109]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1e59ee72-3197-457a-849a-50911dcc10dc [ 1150.394595] env[68109]: During handling of the above exception, another exception occurred: [ 1150.394595] env[68109]: Traceback (most recent call last): [ 1150.394867] env[68109]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1150.394867] env[68109]: listener.cb(fileno) [ 1150.394867] env[68109]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1150.394867] env[68109]: result = function(*args, **kwargs) [ 1150.394867] env[68109]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1150.394867] env[68109]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1150.394867] env[68109]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1150.394867] env[68109]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1150.394867] env[68109]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1150.394867] env[68109]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1150.394867] env[68109]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1150.394867] env[68109]: res.raise_for_status() [ 1150.394867] env[68109]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1150.394867] env[68109]: raise HTTPError(http_error_msg, response=self) [ 1150.394867] env[68109]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/1e59ee72-3197-457a-849a-50911dcc10dc [ 1150.394867] env[68109]: Removing descriptor: 19 [ 1151.317780] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: SUCCESS [ 1151.318131] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.318131] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.318329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.318514] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.318632] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.318698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.318847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.318919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.319015] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.821129] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.821333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.821333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.821502] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.831328] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: SUCCESS [ 1151.831612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.831811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.832069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.832274] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.832405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.832478] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.832626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.832707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.832794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.832891] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.840469] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.840732] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.840855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.840960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.841174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.841269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.841398] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95643695-b4c0-4631-8571-eb7422297d00 is going to be updated. [ 1151.866380] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.866531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.866598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.866798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.867026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.874569] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: IN_PROGRESS for 2s [ 1152.335305] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.335614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.335977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.335977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.336233] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.336422] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.336539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.336760] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.336860] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.336977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.337176] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.337270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.337331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.337474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.337609] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.337700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.337761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.338262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.338262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.338262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.338399] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.840946] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 530264c4-f8bd-43b3-94f9-812deb7104ab: rpc.has_security_group_logging(os_id): False [ 1152.858641] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.858791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.858850] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.859086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.875924] env[68109]: INFO networking_nsxv3.common.synchronization [req-2f33a421-5d82-4df9-90d0-95ff6466ffce req-c6dac811-03f7-45f7-a6c8-cf4968781595 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_members [ 1152.876910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.877189] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.877326] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.877424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.877624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.877707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.877899] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.878071] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.878137] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.878246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.878324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.878525] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.878619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.878678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.878852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.878965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.879066] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab is going to be updated. [ 1152.880307] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGHEST for action security_group_members [ 1152.880605] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-690e6efd-f18b-488b-b84c-5caae41cc733 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.880710] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.880775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.880918] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.881063] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.881154] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.881211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.881341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.881414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.881501] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.941658] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.941812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.941878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.942107] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.942251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.964112] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: IN_PROGRESS for 2s [ 1153.383339] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.383682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.383682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.383817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.404343] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.404591] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.404706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.404772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.405031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.405135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.405233] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e6efd-f18b-488b-b84c-5caae41cc733 is going to be updated. [ 1153.429168] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.429300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.429372] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.429614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.429772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.437286] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e6efd-f18b-488b-b84c-5caae41cc733 in Status: IN_PROGRESS for 2s [ 1153.883785] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: SUCCESS [ 1153.884019] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95643695-b4c0-4631-8571-eb7422297d00 deletion is rescheduled due to dependency. [ 1153.885268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.885268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.885268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.885268] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.885268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.885268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.885268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.885268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.885559] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.387741] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.388119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.389118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.389118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.389118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.389118] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.389319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.389474] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.389736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.389885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.390074] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95643695-b4c0-4631-8571-eb7422297d00 is going to be updated. [ 1154.413806] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.414124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.414235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.414542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.414778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.423017] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: IN_PROGRESS for 2s [ 1154.978651] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: SUCCESS [ 1154.978901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.447107] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 690e6efd-f18b-488b-b84c-5caae41cc733 in Status: SUCCESS [ 1155.447365] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 690e6efd-f18b-488b-b84c-5caae41cc733 deletion is rescheduled due to dependency. [ 1155.447462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.433976] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: SUCCESS [ 1156.434342] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95643695-b4c0-4631-8571-eb7422297d00 deletion is rescheduled due to dependency. [ 1156.434547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.434830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.435184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.435517] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.435715] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.435869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.436811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.437184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.437424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.437928] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.439352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.439692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.440014] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.440653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.440839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.441151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.441304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.441485] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.543699] env[68109]: INFO networking_nsxv3.common.synchronization [None req-38478a2f-c172-4f8d-a7de-f58385ff78e6 None None] Enqueued Resource ID: ddd30bd8-d546-4366-9596-feff6c68059b with Priority: HIGHEST for action port [ 1156.543699] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddd30bd8-d546-4366-9596-feff6c68059b with Priority: HIGHEST for action port [ 1156.544240] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddd30bd8-d546-4366-9596-feff6c68059b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.544425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddd30bd8-d546-4366-9596-feff6c68059b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.544536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddd30bd8-d546-4366-9596-feff6c68059b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.544833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddd30bd8-d546-4366-9596-feff6c68059b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.544998] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd30bd8-d546-4366-9596-feff6c68059b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.945259] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.947235] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.947235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.947235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.947235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.947235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.947235] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.947235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.947235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.947235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.947235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.947235] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95643695-b4c0-4631-8571-eb7422297d00 is going to be updated. [ 1156.972351] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.972545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.972594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.972755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.972894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.981930] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: IN_PROGRESS for 2s [ 1157.048402] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddd30bd8-d546-4366-9596-feff6c68059b [ 1157.048640] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.048773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.048841] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.049475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.049509] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.049609] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddd30bd8-d546-4366-9596-feff6c68059b already deleted. [ 1157.049692] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddd30bd8-d546-4366-9596-feff6c68059b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.402749] env[68109]: INFO networking_nsxv3.common.synchronization [req-7f6dfb64-8a6e-43f1-ac6c-0c84f29bce17 req-010b0864-140a-4ba1-8221-9b8e85351bb0 tempest-ImagesOneServerNegativeTestJSON-1955885897 tempest-ImagesOneServerNegativeTestJSON-1955885897-project-member] Enqueued Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1157.403343] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGHEST for action security_group_members [ 1157.403459] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.403625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.403680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.403846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.403998] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.404470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.405753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.405753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.405753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.405753] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.452030] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 95643695-b4c0-4631-8571-eb7422297d00: rpc.has_security_group_logging(os_id): False [ 1157.469811] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.471138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.471259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.471524] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.471617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.471845] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.471950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.472028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.472198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.472271] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.472361] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95643695-b4c0-4631-8571-eb7422297d00 is going to be updated. [ 1157.529582] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.529582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.529582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.529582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.529582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.540227] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: IN_PROGRESS for 2s [ 1157.911460] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.911460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.911460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.911460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.911460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.911460] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.911460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.911460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.911460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.911460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.911460] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab is going to be updated. [ 1157.919017] env[68109]: INFO networking_nsxv3.common.synchronization [None req-6209a6a4-15b0-4095-934a-05cb45f8ed7e None None] Enqueued Resource ID: 42e22409-4e04-4b3f-9f43-20afffa17326 with Priority: HIGHEST for action port [ 1157.919017] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42e22409-4e04-4b3f-9f43-20afffa17326 with Priority: HIGHEST for action port [ 1157.919017] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-42e22409-4e04-4b3f-9f43-20afffa17326 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.919017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42e22409-4e04-4b3f-9f43-20afffa17326" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.919017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42e22409-4e04-4b3f-9f43-20afffa17326" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.919017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42e22409-4e04-4b3f-9f43-20afffa17326" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.919017] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42e22409-4e04-4b3f-9f43-20afffa17326',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.936413] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.936413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.936413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.936622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.936622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.945131] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: IN_PROGRESS for 2s [ 1158.421830] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42e22409-4e04-4b3f-9f43-20afffa17326 [ 1158.421830] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.421830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.421830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.422089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.422089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.422233] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42e22409-4e04-4b3f-9f43-20afffa17326 already deleted. [ 1158.422268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42e22409-4e04-4b3f-9f43-20afffa17326" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.465368] env[68109]: INFO networking_nsxv3.common.synchronization [None req-59e48ace-f9cf-4efb-a639-29a40960f834 tempest-AttachInterfacesTestJSON-321089733 tempest-AttachInterfacesTestJSON-321089733-project-member] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1158.465699] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGHEST for action security_group_members [ 1158.470546] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.471605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.471605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.471605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.471605] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.471605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.471605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.471605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.471605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.471884] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.671091] env[68109]: INFO networking_nsxv3.common.synchronization [None req-2977c221-7951-4120-8b53-34705f8bd063 None None] Enqueued Resource ID: 3a2eb33d-ee40-49d1-9cc4-52382125dbb1 with Priority: HIGHEST for action port [ 1158.672267] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a2eb33d-ee40-49d1-9cc4-52382125dbb1 with Priority: HIGHEST for action port [ 1158.672267] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a2eb33d-ee40-49d1-9cc4-52382125dbb1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.672267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a2eb33d-ee40-49d1-9cc4-52382125dbb1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.672267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a2eb33d-ee40-49d1-9cc4-52382125dbb1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.672513] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a2eb33d-ee40-49d1-9cc4-52382125dbb1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.672513] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a2eb33d-ee40-49d1-9cc4-52382125dbb1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.877990] env[68109]: INFO networking_nsxv3.common.synchronization [None req-1b241efb-244f-4084-874c-5c086655a74e None None] Enqueued Resource ID: 4292cd15-4591-4dca-be25-1c837b7de9ee with Priority: HIGHEST for action port [ 1158.878554] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4292cd15-4591-4dca-be25-1c837b7de9ee with Priority: HIGHEST for action port [ 1158.878904] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-4292cd15-4591-4dca-be25-1c837b7de9ee taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.879196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4292cd15-4591-4dca-be25-1c837b7de9ee" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.879317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4292cd15-4591-4dca-be25-1c837b7de9ee" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.879600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4292cd15-4591-4dca-be25-1c837b7de9ee" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.879680] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4292cd15-4591-4dca-be25-1c837b7de9ee',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.974534] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.974839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.974839] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.975294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.991311] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: SUCCESS [ 1158.991311] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 95643695-b4c0-4631-8571-eb7422297d00 deletion is rescheduled due to dependency. [ 1158.991311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.996514] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.996759] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.996873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.996939] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.997215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.997317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.997410] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be updated. [ 1159.021182] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.021182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.021759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.021759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.021878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.029346] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: IN_PROGRESS for 2s [ 1159.178352] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a2eb33d-ee40-49d1-9cc4-52382125dbb1 [ 1159.179523] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.179523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.179523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.179523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.179523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.179523] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a2eb33d-ee40-49d1-9cc4-52382125dbb1 already deleted. [ 1159.179523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a2eb33d-ee40-49d1-9cc4-52382125dbb1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.381510] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4292cd15-4591-4dca-be25-1c837b7de9ee [ 1159.381757] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.381894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.381967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.382384] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.382384] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.383094] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4292cd15-4591-4dca-be25-1c837b7de9ee already deleted. [ 1159.383094] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4292cd15-4591-4dca-be25-1c837b7de9ee" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.555171] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 95643695-b4c0-4631-8571-eb7422297d00 in Status: SUCCESS [ 1159.555357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.555534] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.555778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.555866] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('95643695-b4c0-4631-8571-eb7422297d00',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.620172] env[68109]: INFO networking_nsxv3.common.synchronization [None req-04dce1c1-426d-41a4-9e3c-407a14b7506d tempest-VolumesAdminNegativeTest-1005465113 tempest-VolumesAdminNegativeTest-1005465113-project-member] Enqueued Resource ID: 45989221-3dfe-4534-880b-3513e8f84d12 with Priority: HIGHEST for action security_group_rules [ 1159.620987] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45989221-3dfe-4534-880b-3513e8f84d12 with Priority: HIGHEST for action security_group_rules [ 1159.621408] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45989221-3dfe-4534-880b-3513e8f84d12 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.621613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.621702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.621991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.623768] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45989221-3dfe-4534-880b-3513e8f84d12',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.699721] env[68109]: INFO networking_nsxv3.common.synchronization [None req-14390065-6deb-4877-92cf-5020c1987c37 tempest-VolumesAdminNegativeTest-1005465113 tempest-VolumesAdminNegativeTest-1005465113-project-member] Enqueued Resource ID: 45989221-3dfe-4534-880b-3513e8f84d12 with Priority: HIGHEST for action security_group_rules [ 1159.699721] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45989221-3dfe-4534-880b-3513e8f84d12 with Priority: HIGHEST for action security_group_rules [ 1159.699721] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45989221-3dfe-4534-880b-3513e8f84d12 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.699721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.954490] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 530264c4-f8bd-43b3-94f9-812deb7104ab in Status: SUCCESS [ 1159.954490] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab deletion is rescheduled due to dependency. [ 1159.954490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.007027] env[68109]: INFO networking_nsxv3.common.synchronization [req-04d273ba-abf9-4eaa-bf11-32a49a70ffb2 req-48bda024-84bd-4cba-a64d-c0e8dc4ab69e tempest-AttachVolumeShelveTestJSON-1309092891 tempest-AttachVolumeShelveTestJSON-1309092891-project-member] Enqueued Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_members [ 1160.007027] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGHEST for action security_group_members [ 1160.007027] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.007027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.007027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.007027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.007027] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.007027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.007027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.007027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.007027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.008026] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.079946] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.079946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.079946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.079946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.093875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.093875] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 95643695-b4c0-4631-8571-eb7422297d00 is going to be deleted. [ 1160.138993] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.139157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.139377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.139781] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.139882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.139993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-95643695-b4c0-4631-8571-eb7422297d00" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.145941] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.145941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.145941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.145941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.145941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.145941] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45989221-3dfe-4534-880b-3513e8f84d12 already deleted. [ 1160.145941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.145941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.145941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.145941] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45989221-3dfe-4534-880b-3513e8f84d12',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.509993] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.512008] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.512008] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.512008] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.531125] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.531125] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.531247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.531279] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.531482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.531564] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.531659] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 is going to be updated. [ 1160.561146] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.561146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.561146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.561396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.561486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.569240] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 in Status: IN_PROGRESS for 2s [ 1160.629193] env[68109]: INFO networking_nsxv3.common.synchronization [None req-5f1f9041-5c04-446f-8998-d9e725b11813 None None] Enqueued Resource ID: 0f38a71e-d555-4464-9f58-850d92cf2278 with Priority: HIGHEST for action port [ 1160.629741] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f38a71e-d555-4464-9f58-850d92cf2278 with Priority: HIGHEST for action port [ 1160.630074] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f38a71e-d555-4464-9f58-850d92cf2278 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.630284] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f38a71e-d555-4464-9f58-850d92cf2278" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.630284] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f38a71e-d555-4464-9f58-850d92cf2278" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.630769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f38a71e-d555-4464-9f58-850d92cf2278" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.636250] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f38a71e-d555-4464-9f58-850d92cf2278',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.687928] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.688044] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.688044] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.691374] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.691374] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.691374] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45989221-3dfe-4534-880b-3513e8f84d12 already deleted. [ 1160.691374] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.992635] env[68109]: INFO networking_nsxv3.common.synchronization [None req-b700c967-457e-47a3-ba45-54051e32abab None None] Enqueued Resource ID: 5268a557-f6a5-498f-96da-8c537b431706 with Priority: HIGHEST for action port [ 1160.993394] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5268a557-f6a5-498f-96da-8c537b431706 with Priority: HIGHEST for action port [ 1160.993801] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-5268a557-f6a5-498f-96da-8c537b431706 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.993939] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5268a557-f6a5-498f-96da-8c537b431706" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.994013] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5268a557-f6a5-498f-96da-8c537b431706" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.994303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5268a557-f6a5-498f-96da-8c537b431706" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.994412] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5268a557-f6a5-498f-96da-8c537b431706',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.037814] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf in Status: SUCCESS [ 1161.038274] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf deletion is rescheduled due to dependency. [ 1161.038274] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.139886] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f38a71e-d555-4464-9f58-850d92cf2278 [ 1161.140054] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.140250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.140250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.140479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.140569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.140669] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f38a71e-d555-4464-9f58-850d92cf2278 already deleted. [ 1161.140752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f38a71e-d555-4464-9f58-850d92cf2278" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.497564] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5268a557-f6a5-498f-96da-8c537b431706 [ 1161.497839] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.497999] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.498124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.498411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.498516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.498616] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5268a557-f6a5-498f-96da-8c537b431706 already deleted. [ 1161.498698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5268a557-f6a5-498f-96da-8c537b431706" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.580697] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 in Status: SUCCESS [ 1162.580697] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 deletion is rescheduled due to dependency. [ 1162.580697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.043130] env[68109]: INFO networking_nsxv3.common.synchronization [None req-3145640b-0ee0-42ef-93a3-b02cde31fb92 None None] Enqueued Resource ID: 6ac8a24a-3c53-4d66-a2e4-5295b87c3947 with Priority: HIGHEST for action port [ 1163.043391] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac8a24a-3c53-4d66-a2e4-5295b87c3947 with Priority: HIGHEST for action port [ 1163.043952] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ac8a24a-3c53-4d66-a2e4-5295b87c3947 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.044131] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ac8a24a-3c53-4d66-a2e4-5295b87c3947" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.044207] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ac8a24a-3c53-4d66-a2e4-5295b87c3947" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.044406] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ac8a24a-3c53-4d66-a2e4-5295b87c3947" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.044629] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ac8a24a-3c53-4d66-a2e4-5295b87c3947',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.548452] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ac8a24a-3c53-4d66-a2e4-5295b87c3947 [ 1163.548645] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.548805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.548851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.549075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.549530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.549530] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ac8a24a-3c53-4d66-a2e4-5295b87c3947 already deleted. [ 1163.549530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ac8a24a-3c53-4d66-a2e4-5295b87c3947" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.186750] env[68109]: INFO networking_nsxv3.common.synchronization [req-0bc9a7d5-f201-42c1-9e79-308f5ceb400a req-7a0f44d5-2710-4497-b5e9-6c011e89073b tempest-ServersTestJSON-402636039 tempest-ServersTestJSON-402636039-project-member] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1164.188030] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1164.188030] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.188030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.188030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.191723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.192380] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.192380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.192380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.192380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.192380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.193161] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.645055] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.645055] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.645055] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.645055] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.645055] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.645055] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.645553] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.645896] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.646239] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.646564] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1164.646800] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1164.647026] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1164.647236] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1164.647460] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1164.647670] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1164.647918] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1164.668246] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1164.669388] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1164.669681] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1164.669971] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.670557] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-859590c1-db8b-4025-82f1-0bd2367b8b3a taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.671583] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-859590c1-db8b-4025-82f1-0bd2367b8b3a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.671583] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-859590c1-db8b-4025-82f1-0bd2367b8b3a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.671583] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-859590c1-db8b-4025-82f1-0bd2367b8b3a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.671583] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('859590c1-db8b-4025-82f1-0bd2367b8b3a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.697163] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.697163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.697163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.697163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.697163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.697163] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.697163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.697163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.697163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.697163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.697163] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c already deleted. [ 1164.697163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.986411] env[68109]: INFO networking_nsxv3.common.synchronization [None req-a88ad7b7-41f2-4877-af85-94cb638c79f4 None None] Enqueued Resource ID: ecfd4af4-122d-43b0-860d-2b582e164e5c with Priority: HIGHEST for action port [ 1164.986974] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecfd4af4-122d-43b0-860d-2b582e164e5c with Priority: HIGHEST for action port [ 1164.987789] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecfd4af4-122d-43b0-860d-2b582e164e5c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.987789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecfd4af4-122d-43b0-860d-2b582e164e5c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.987789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecfd4af4-122d-43b0-860d-2b582e164e5c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.987980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecfd4af4-122d-43b0-860d-2b582e164e5c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.988152] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecfd4af4-122d-43b0-860d-2b582e164e5c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.175403] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.175403] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.175730] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.175935] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.176042] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.176174] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 859590c1-db8b-4025-82f1-0bd2367b8b3a not found, creating... [ 1165.176585] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.176811] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.176811] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.177047] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.177162] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.177740] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.177740] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.177895] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.177991] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.178144] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.178290] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 859590c1-db8b-4025-82f1-0bd2367b8b3a is going to be created. [ 1165.198812] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.199160] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.199160] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.199415] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.199653] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.199870] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-859590c1-db8b-4025-82f1-0bd2367b8b3a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.491422] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecfd4af4-122d-43b0-860d-2b582e164e5c [ 1165.491655] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.491793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.491867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.492087] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.492177] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.492278] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecfd4af4-122d-43b0-860d-2b582e164e5c already deleted. [ 1165.492360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecfd4af4-122d-43b0-860d-2b582e164e5c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.902504] env[68109]: INFO networking_nsxv3.common.synchronization [None req-49cf83e8-03d8-436f-bdc9-013564c94fca None None] Enqueued Resource ID: f77600f9-0dd1-4103-96aa-478fd7d775b6 with Priority: HIGHEST for action port [ 1165.902504] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77600f9-0dd1-4103-96aa-478fd7d775b6 with Priority: HIGHEST for action port [ 1165.902504] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f77600f9-0dd1-4103-96aa-478fd7d775b6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.902504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f77600f9-0dd1-4103-96aa-478fd7d775b6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.902759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f77600f9-0dd1-4103-96aa-478fd7d775b6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.903568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f77600f9-0dd1-4103-96aa-478fd7d775b6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.903568] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f77600f9-0dd1-4103-96aa-478fd7d775b6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.926241] env[68109]: INFO networking_nsxv3.common.synchronization [req-0bc9a7d5-f201-42c1-9e79-308f5ceb400a req-30c839ed-770e-4ebc-8b27-c85d9dd95ed0 service nova] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_rules [ 1165.926420] env[68109]: INFO networking_nsxv3.common.synchronization [req-0bc9a7d5-f201-42c1-9e79-308f5ceb400a req-30c839ed-770e-4ebc-8b27-c85d9dd95ed0 service nova] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1165.926762] env[68109]: INFO networking_nsxv3.common.synchronization [req-0bc9a7d5-f201-42c1-9e79-308f5ceb400a req-30c839ed-770e-4ebc-8b27-c85d9dd95ed0 service nova] Enqueued Resource ID: 859590c1-db8b-4025-82f1-0bd2367b8b3a with Priority: HIGHEST for action port [ 1165.926806] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_rules [ 1165.926899] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1165.926994] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 859590c1-db8b-4025-82f1-0bd2367b8b3a with Priority: HIGHEST for action port [ 1165.927813] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.927983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.931680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.931680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.931680] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.931680] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.931680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.931680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.931680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.931680] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.931680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.931680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.931680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.931680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.931680] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.932600] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-859590c1-db8b-4025-82f1-0bd2367b8b3a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.932600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-859590c1-db8b-4025-82f1-0bd2367b8b3a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.932600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-859590c1-db8b-4025-82f1-0bd2367b8b3a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.932600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-859590c1-db8b-4025-82f1-0bd2367b8b3a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.932903] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('859590c1-db8b-4025-82f1-0bd2367b8b3a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.409243] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f77600f9-0dd1-4103-96aa-478fd7d775b6 [ 1166.409480] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.409543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.409643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.409852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.409900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.410507] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f77600f9-0dd1-4103-96aa-478fd7d775b6 already deleted. [ 1166.410507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f77600f9-0dd1-4103-96aa-478fd7d775b6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.435261] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.438594] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.438594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.438594] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 859590c1-db8b-4025-82f1-0bd2367b8b3a with status ACTIVE [ 1166.438594] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.438594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.438594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.438594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.438594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.438594] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.438594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.438594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.438594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.438594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.438594] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.439391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.439391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.439391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.439391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.439391] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 859590c1-db8b-4025-82f1-0bd2367b8b3a is going to be updated. [ 1166.459480] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.459480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.459480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.459480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.459480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.459837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-859590c1-db8b-4025-82f1-0bd2367b8b3a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.940751] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.443233] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.443544] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.443544] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.444294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.444294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.444294] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be created. [ 1167.469108] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.469276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.469328] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.469512] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.469670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.479273] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: UNINITIALIZED for 2s [ 1168.098720] env[68109]: INFO networking_nsxv3.common.synchronization [None req-ceb623f5-21a4-4eb0-a6c3-a2c51d194c93 None None] Enqueued Resource ID: 5fa450b6-510a-40bf-a33b-2f446bc57d61 with Priority: HIGHEST for action port [ 1168.099267] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa450b6-510a-40bf-a33b-2f446bc57d61 with Priority: HIGHEST for action port [ 1168.099563] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fa450b6-510a-40bf-a33b-2f446bc57d61 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.099690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fa450b6-510a-40bf-a33b-2f446bc57d61" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.099870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fa450b6-510a-40bf-a33b-2f446bc57d61" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.100013] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fa450b6-510a-40bf-a33b-2f446bc57d61" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.100098] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fa450b6-510a-40bf-a33b-2f446bc57d61',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.601963] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fa450b6-510a-40bf-a33b-2f446bc57d61 [ 1168.602261] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.603231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.603231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.603231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.603231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.603231] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fa450b6-510a-40bf-a33b-2f446bc57d61 already deleted. [ 1168.603231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fa450b6-510a-40bf-a33b-2f446bc57d61" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.079148] env[68109]: INFO networking_nsxv3.common.synchronization [req-6b9b06b1-f80a-4969-aab0-599db02adce1 req-9c3d2e32-b5e9-45cd-933d-eacebaa4ac27 tempest-VolumesAdminNegativeTest-1005465113 tempest-VolumesAdminNegativeTest-1005465113-project-member] Enqueued Resource ID: 45989221-3dfe-4534-880b-3513e8f84d12 with Priority: HIGHEST for action security_group_members [ 1169.079657] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45989221-3dfe-4534-880b-3513e8f84d12 with Priority: HIGHEST for action security_group_members [ 1169.079957] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-45989221-3dfe-4534-880b-3513e8f84d12 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.080098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.080164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.080414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.080569] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.080671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.080745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.080907] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.080992] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.081099] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45989221-3dfe-4534-880b-3513e8f84d12',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.367841] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-825 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.368050] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-825" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.368177] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-825" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.368525] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-825" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.368781] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.369435] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.369435] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.369435] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.369435] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.369629] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1169.370116] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.370116] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.370116] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.370116] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1169.370296] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.370296] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.389043] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.390030] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1169.390030] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.390030] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-825" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.390318] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-48a3216d-9715-4f40-a31d-ac730738c4ce taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.390547] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-48a3216d-9715-4f40-a31d-ac730738c4ce" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.390714] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-48a3216d-9715-4f40-a31d-ac730738c4ce" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.391067] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-48a3216d-9715-4f40-a31d-ac730738c4ce" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.391251] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48a3216d-9715-4f40-a31d-ac730738c4ce',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.488043] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1169.488274] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.488476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.488687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.488878] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.488994] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.489078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.489215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.489294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.489382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.489470] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.584466] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.584616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.584688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.584895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.584984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.585214] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.585329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.585394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.585545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.585621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.585710] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45989221-3dfe-4534-880b-3513e8f84d12 already deleted. [ 1169.585788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.893619] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.894033] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.894033] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.894267] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.894423] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.894622] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 48a3216d-9715-4f40-a31d-ac730738c4ce not found, creating... [ 1169.894890] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.895071] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.895229] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.895428] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.895570] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.895855] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.896066] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.896232] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.896454] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.896596] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.896755] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 48a3216d-9715-4f40-a31d-ac730738c4ce is going to be created. [ 1169.914884] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.915143] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.915308] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.915682] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.915964] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.916223] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-48a3216d-9715-4f40-a31d-ac730738c4ce" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.992264] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.992496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.992665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.992995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.993245] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.993431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.993499] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.993698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.993816] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.993939] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.994163] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.994293] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.994450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.994660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.994885] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.994983] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.995084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.995302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.995409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.995522] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.995644] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.497816] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 025fe221-7ef8-4d28-bdd2-f925cbbe673c: rpc.has_security_group_logging(os_id): False [ 1170.516444] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.516671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.516772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.517015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.517175] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.519313] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.519449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.519497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.519669] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.519753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.519944] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.520053] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.520115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.520259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.520333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.520518] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.520624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.520677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.520788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.520858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.520943] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be created. [ 1170.580238] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.580436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.580534] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.580766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.580976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.596395] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1170.605244] env[68109]: INFO networking_nsxv3.common.synchronization [req-6b9b06b1-f80a-4969-aab0-599db02adce1 req-b665b165-bc2f-402d-90cd-b0a39a338edf service nova] Enqueued Resource ID: 45989221-3dfe-4534-880b-3513e8f84d12 with Priority: HIGHEST for action security_group_rules [ 1170.605244] env[68109]: INFO networking_nsxv3.common.synchronization [req-6b9b06b1-f80a-4969-aab0-599db02adce1 req-b665b165-bc2f-402d-90cd-b0a39a338edf service nova] Enqueued Resource ID: 45989221-3dfe-4534-880b-3513e8f84d12 with Priority: HIGHEST for action security_group_members [ 1170.605244] env[68109]: INFO networking_nsxv3.common.synchronization [req-6b9b06b1-f80a-4969-aab0-599db02adce1 req-b665b165-bc2f-402d-90cd-b0a39a338edf service nova] Enqueued Resource ID: 48a3216d-9715-4f40-a31d-ac730738c4ce with Priority: HIGHEST for action port [ 1170.605244] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45989221-3dfe-4534-880b-3513e8f84d12 with Priority: HIGHEST for action security_group_rules [ 1170.605244] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45989221-3dfe-4534-880b-3513e8f84d12 with Priority: HIGHEST for action security_group_members [ 1170.605244] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48a3216d-9715-4f40-a31d-ac730738c4ce with Priority: HIGHEST for action port [ 1170.605244] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45989221-3dfe-4534-880b-3513e8f84d12 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.605244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.605244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.605244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.605244] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45989221-3dfe-4534-880b-3513e8f84d12',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.606921] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-45989221-3dfe-4534-880b-3513e8f84d12 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.606921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.606921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.606921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.606921] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.606921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.606921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.608450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.608450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.608450] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45989221-3dfe-4534-880b-3513e8f84d12',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.608450] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-48a3216d-9715-4f40-a31d-ac730738c4ce taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.608450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48a3216d-9715-4f40-a31d-ac730738c4ce" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.608450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48a3216d-9715-4f40-a31d-ac730738c4ce" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.608450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48a3216d-9715-4f40-a31d-ac730738c4ce" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.608450] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48a3216d-9715-4f40-a31d-ac730738c4ce',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.954906] env[68109]: INFO networking_nsxv3.common.synchronization [None req-af93701a-b598-4c06-9181-692d7a42f515 tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 with Priority: HIGHEST for action security_group_rules [ 1170.955457] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 with Priority: HIGHEST for action security_group_rules [ 1170.955767] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.955889] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.955951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.956225] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.956313] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f78efa9-13fb-4180-9b01-5be62a5cd4c6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.086224] env[68109]: INFO networking_nsxv3.common.synchronization [None req-d14ef9cc-e732-4b13-bc22-1ccb5a62110a tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 with Priority: HIGHEST for action security_group_rules [ 1171.086775] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 with Priority: HIGHEST for action security_group_rules [ 1171.086987] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.087103] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.110179] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-45989221-3dfe-4534-880b-3513e8f84d12 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.110286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.111568] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48a3216d-9715-4f40-a31d-ac730738c4ce with status ACTIVE [ 1171.111741] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.111863] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.111926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.112144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.112233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.112405] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.112501] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.112560] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.112711] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.112788] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.112965] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.113067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.113119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.113309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.113342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.113406] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48a3216d-9715-4f40-a31d-ac730738c4ce is going to be updated. [ 1171.114442] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45989221-3dfe-4534-880b-3513e8f84d12',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.133156] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.133341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.133410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.133547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.133679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.133835] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48a3216d-9715-4f40-a31d-ac730738c4ce" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.472934] env[68109]: INFO networking_nsxv3.common.synchronization [req-24f69a9d-efb0-40a9-b0d3-891d990dd2ba req-f048ce71-0679-472b-a50f-77931a5196c2 tempest-ServersNegativeTestMultiTenantJSON-168347197 tempest-ServersNegativeTestMultiTenantJSON-168347197-project-member] Enqueued Resource ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e with Priority: HIGHEST for action security_group_members [ 1171.473470] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e with Priority: HIGHEST for action security_group_members [ 1171.474623] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.474623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.474623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.474892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.474892] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.474973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.475065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.475504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.475504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.475504] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32c2ad67-dff8-4ece-b3e8-2d6f1363534e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.477064] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.477224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.477634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.477863] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.478194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.478194] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 already deleted. [ 1171.478307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.479026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.479223] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.479318] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f78efa9-13fb-4180-9b01-5be62a5cd4c6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.617524] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45989221-3dfe-4534-880b-3513e8f84d12',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.877166] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-790 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.877407] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-790" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.877553] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-790" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.877946] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-790" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.878229] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.878416] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.878550] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.879107] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.879573] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.879573] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1171.879685] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1171.879765] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1171.880026] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1171.880026] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1171.880129] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1171.880253] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1171.897552] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1171.897753] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1171.897917] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1171.898137] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-790" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.898501] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-55fff699-303c-4ff3-ad18-875393307017 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.898695] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-55fff699-303c-4ff3-ad18-875393307017" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.898841] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-55fff699-303c-4ff3-ad18-875393307017" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.899166] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-55fff699-303c-4ff3-ad18-875393307017" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.899329] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55fff699-303c-4ff3-ad18-875393307017',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.981624] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.982147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.982147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.982147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.982329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.982566] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.982732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.982833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.983082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.983222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.983366] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e already deleted. [ 1171.983465] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.001403] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.001544] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.001638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.001862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.001963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.002107] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 already deleted. [ 1172.002219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.119374] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.119536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.119597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.119862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.119984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.119984] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45989221-3dfe-4534-880b-3513e8f84d12 is going to be created. [ 1172.142462] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.142616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.142676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.142858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.143314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.151137] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45989221-3dfe-4534-880b-3513e8f84d12 in Status: UNINITIALIZED for 2s [ 1172.401618] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.401886] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.402357] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.402432] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.403606] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.403606] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 55fff699-303c-4ff3-ad18-875393307017 not found, creating... [ 1172.403606] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.403606] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.403606] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.403606] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.403861] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.404049] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.404186] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.404272] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.404499] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.404673] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.404771] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 55fff699-303c-4ff3-ad18-875393307017 is going to be created. [ 1172.426031] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.426411] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.426598] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.426899] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.427155] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.427413] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-55fff699-303c-4ff3-ad18-875393307017" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.609140] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1172.609228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.141349] env[68109]: INFO networking_nsxv3.common.synchronization [req-24f69a9d-efb0-40a9-b0d3-891d990dd2ba req-34b63ef4-6fd7-4be3-b2ad-dadf9a67ed00 service nova] Enqueued Resource ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e with Priority: HIGHEST for action security_group_rules [ 1173.141592] env[68109]: INFO networking_nsxv3.common.synchronization [req-24f69a9d-efb0-40a9-b0d3-891d990dd2ba req-34b63ef4-6fd7-4be3-b2ad-dadf9a67ed00 service nova] Enqueued Resource ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e with Priority: HIGHEST for action security_group_members [ 1173.144031] env[68109]: INFO networking_nsxv3.common.synchronization [req-24f69a9d-efb0-40a9-b0d3-891d990dd2ba req-34b63ef4-6fd7-4be3-b2ad-dadf9a67ed00 service nova] Enqueued Resource ID: 55fff699-303c-4ff3-ad18-875393307017 with Priority: HIGHEST for action port [ 1173.144031] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e with Priority: HIGHEST for action security_group_rules [ 1173.144031] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e with Priority: HIGHEST for action security_group_members [ 1173.144031] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55fff699-303c-4ff3-ad18-875393307017 with Priority: HIGHEST for action port [ 1173.144031] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32c2ad67-dff8-4ece-b3e8-2d6f1363534e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.144031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.144031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.144031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.144031] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32c2ad67-dff8-4ece-b3e8-2d6f1363534e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.144520] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.144520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.144605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.144844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.144931] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.145051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.145121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.145315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.145476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.145593] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32c2ad67-dff8-4ece-b3e8-2d6f1363534e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.146397] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-55fff699-303c-4ff3-ad18-875393307017 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.146527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55fff699-303c-4ff3-ad18-875393307017" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.146597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55fff699-303c-4ff3-ad18-875393307017" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.146786] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55fff699-303c-4ff3-ad18-875393307017" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.146839] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55fff699-303c-4ff3-ad18-875393307017',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.648132] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32c2ad67-dff8-4ece-b3e8-2d6f1363534e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.649218] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.649327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.649685] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55fff699-303c-4ff3-ad18-875393307017 with status ACTIVE [ 1173.649945] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.649945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.650073] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.650210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.650297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.650467] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.650574] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.650616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.650770] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.650847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.651029] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.651124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.651183] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.651325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.651584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.651584] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55fff699-303c-4ff3-ad18-875393307017 is going to be updated. [ 1173.670433] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.670559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.670610] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.670779] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.670903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.671066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55fff699-303c-4ff3-ad18-875393307017" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.152263] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32c2ad67-dff8-4ece-b3e8-2d6f1363534e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.161596] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45989221-3dfe-4534-880b-3513e8f84d12 in Status: SUCCESS [ 1174.161822] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.161962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.162266] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.162473] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.162473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.162558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.162774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.162774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.162876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.162920] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45989221-3dfe-4534-880b-3513e8f84d12',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.327539] env[68109]: INFO networking_nsxv3.common.synchronization [None req-08577d2f-5d32-498b-b08f-be70dd582663 None None] Enqueued Resource ID: 0a119c58-3d8e-454a-a38e-c3a4da92dd4a with Priority: HIGHEST for action port [ 1174.328144] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a119c58-3d8e-454a-a38e-c3a4da92dd4a with Priority: HIGHEST for action port [ 1174.328591] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a119c58-3d8e-454a-a38e-c3a4da92dd4a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.328768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a119c58-3d8e-454a-a38e-c3a4da92dd4a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.328888] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a119c58-3d8e-454a-a38e-c3a4da92dd4a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.329187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a119c58-3d8e-454a-a38e-c3a4da92dd4a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.329308] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a119c58-3d8e-454a-a38e-c3a4da92dd4a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.654961] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.655054] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.655091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.655338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.655456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.655588] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e is going to be created. [ 1174.669744] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45989221-3dfe-4534-880b-3513e8f84d12',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.677569] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.677706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.677767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.677978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.678154] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.686951] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e in Status: UNINITIALIZED for 2s [ 1174.831377] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a119c58-3d8e-454a-a38e-c3a4da92dd4a [ 1174.831655] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.831798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.831868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.832120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.832230] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.832334] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a119c58-3d8e-454a-a38e-c3a4da92dd4a already deleted. [ 1174.832416] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a119c58-3d8e-454a-a38e-c3a4da92dd4a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.172429] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45989221-3dfe-4534-880b-3513e8f84d12: rpc.has_security_group_logging(os_id): False [ 1175.190620] env[68109]: INFO networking_nsxv3.common.synchronization [None req-16cb1b47-ea42-4f73-b084-0366a99f2856 tempest-AttachVolumeTestJSON-790066154 tempest-AttachVolumeTestJSON-790066154-project-member] Enqueued Resource ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 with Priority: HIGHEST for action security_group_rules [ 1175.191214] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 with Priority: HIGHEST for action security_group_rules [ 1175.192244] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.192322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.192393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.192572] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.192653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.192887] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.192984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.193749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.194952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.194952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.194952] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45989221-3dfe-4534-880b-3513e8f84d12 is going to be created. [ 1175.195292] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.195560] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.195560] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.196501] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.196501] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5921dd09-1c8b-4cd1-8a86-569cea9e50d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.251537] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.251687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.251753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.251956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.252175] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.261438] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45989221-3dfe-4534-880b-3513e8f84d12 in Status: IN_PROGRESS for 2s [ 1175.269038] env[68109]: INFO networking_nsxv3.common.synchronization [None req-8faddd27-86a7-4c7e-9aad-13defeab649a tempest-AttachVolumeTestJSON-790066154 tempest-AttachVolumeTestJSON-790066154-project-member] Enqueued Resource ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 with Priority: HIGHEST for action security_group_rules [ 1175.269208] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 with Priority: HIGHEST for action security_group_rules [ 1175.269776] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.270493] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.722855] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.722855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.722855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.722855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.722855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.722855] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 already deleted. [ 1175.722855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.723219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.723219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.723219] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5921dd09-1c8b-4cd1-8a86-569cea9e50d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.244332] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.244674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.244674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.244880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.244880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.244986] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 already deleted. [ 1176.244986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.671709] env[68109]: INFO networking_nsxv3.common.synchronization [None req-297b05fe-1ab7-4393-8d90-19f53b7020b0 None None] Enqueued Resource ID: 426f073d-1ba2-426a-b744-fe7466aa68d5 with Priority: HIGHEST for action port [ 1176.671980] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 426f073d-1ba2-426a-b744-fe7466aa68d5 with Priority: HIGHEST for action port [ 1176.672557] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-426f073d-1ba2-426a-b744-fe7466aa68d5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.672681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-426f073d-1ba2-426a-b744-fe7466aa68d5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.672747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-426f073d-1ba2-426a-b744-fe7466aa68d5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.673014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-426f073d-1ba2-426a-b744-fe7466aa68d5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.673111] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('426f073d-1ba2-426a-b744-fe7466aa68d5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.696087] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e in Status: SUCCESS [ 1176.696308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.696462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.696694] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.696914] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.697050] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.697119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.697289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.697390] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.697480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.697578] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32c2ad67-dff8-4ece-b3e8-2d6f1363534e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.086785] env[68109]: INFO networking_nsxv3.common.synchronization [req-4e2a45da-5b30-48dc-9c2d-97084890b68b req-ccf1e487-b87b-4c11-9380-56b52ea2fa9b tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 with Priority: HIGHEST for action security_group_members [ 1177.087410] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 with Priority: HIGHEST for action security_group_members [ 1177.087681] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.087804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.087881] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.088135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.088289] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.088410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.088471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.088626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.088708] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.088802] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f78efa9-13fb-4180-9b01-5be62a5cd4c6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.175588] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 426f073d-1ba2-426a-b744-fe7466aa68d5 [ 1177.175588] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.175588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.175588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.175852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.175852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.175852] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:426f073d-1ba2-426a-b744-fe7466aa68d5 already deleted. [ 1177.175952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-426f073d-1ba2-426a-b744-fe7466aa68d5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.200063] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.200063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.200291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.200324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.200473] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.200575] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.200636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.200767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.200849] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.200964] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.201171] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.201288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.201352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.201520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.201680] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.201792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.201854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.201997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.202084] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.202166] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.202253] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32c2ad67-dff8-4ece-b3e8-2d6f1363534e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.276805] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45989221-3dfe-4534-880b-3513e8f84d12 in Status: SUCCESS [ 1177.277185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.385020] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.385244] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.385404] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.385655] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.385923] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.386098] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.386389] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.386476] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.386576] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.386870] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.386997] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.387121] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.387230] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.387345] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.387470] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.387623] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.443471] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.443649] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.056 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.443799] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.443983] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.444314] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-c0ae4a9a-4538-4282-be31-a0aef2b9e4b4 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.444535] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-c0ae4a9a-4538-4282-be31-a0aef2b9e4b4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.444681] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-c0ae4a9a-4538-4282-be31-a0aef2b9e4b4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.445071] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-c0ae4a9a-4538-4282-be31-a0aef2b9e4b4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.445237] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0ae4a9a-4538-4282-be31-a0aef2b9e4b4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.590597] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.590810] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.590810] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.591014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.591171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.591317] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.591415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.591477] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.591629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.591703] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.591788] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 already deleted. [ 1177.591866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.706108] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32c2ad67-dff8-4ece-b3e8-2d6f1363534e: rpc.has_security_group_logging(os_id): False [ 1177.722803] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.722979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.723056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.723234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.723358] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.723522] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.723647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.723755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.723836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.723923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.724144] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.724239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.724303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.724464] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.724543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.724745] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.724837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.724898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.725060] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.725138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.725239] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e is going to be created. [ 1177.779205] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.779397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.779446] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.779616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.779813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.790515] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e in Status: IN_PROGRESS for 2s [ 1177.947061] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.947473] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.947732] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.948111] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.948346] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.948593] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port c0ae4a9a-4538-4282-be31-a0aef2b9e4b4 not found, creating... [ 1177.948957] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.949240] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.949431] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.949684] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.949874] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.950282] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.950594] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.950780] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.951068] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.951293] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.951531] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: c0ae4a9a-4538-4282-be31-a0aef2b9e4b4 is going to be created. [ 1177.970825] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.971286] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.971480] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.971818] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.972219] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.972596] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-c0ae4a9a-4538-4282-be31-a0aef2b9e4b4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.619659] env[68109]: INFO networking_nsxv3.common.synchronization [req-4e2a45da-5b30-48dc-9c2d-97084890b68b req-7ff15f42-f642-4ee5-98f4-0348b07718e0 service nova] Enqueued Resource ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 with Priority: HIGHEST for action security_group_rules [ 1178.619945] env[68109]: INFO networking_nsxv3.common.synchronization [req-4e2a45da-5b30-48dc-9c2d-97084890b68b req-7ff15f42-f642-4ee5-98f4-0348b07718e0 service nova] Enqueued Resource ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 with Priority: HIGHEST for action security_group_members [ 1178.620230] env[68109]: INFO networking_nsxv3.common.synchronization [req-4e2a45da-5b30-48dc-9c2d-97084890b68b req-7ff15f42-f642-4ee5-98f4-0348b07718e0 service nova] Enqueued Resource ID: c0ae4a9a-4538-4282-be31-a0aef2b9e4b4 with Priority: HIGHEST for action port [ 1178.620983] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 with Priority: HIGHEST for action security_group_rules [ 1178.621150] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 with Priority: HIGHEST for action security_group_members [ 1178.621341] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ae4a9a-4538-4282-be31-a0aef2b9e4b4 with Priority: HIGHEST for action port [ 1178.621756] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.621957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.622092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.622396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.622539] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f78efa9-13fb-4180-9b01-5be62a5cd4c6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.623754] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.623854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.623945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.624213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.624453] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.624610] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.624718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.624953] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.625119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.625272] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f78efa9-13fb-4180-9b01-5be62a5cd4c6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.626324] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0ae4a9a-4538-4282-be31-a0aef2b9e4b4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.626490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0ae4a9a-4538-4282-be31-a0aef2b9e4b4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.626600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0ae4a9a-4538-4282-be31-a0aef2b9e4b4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.626826] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0ae4a9a-4538-4282-be31-a0aef2b9e4b4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.627402] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0ae4a9a-4538-4282-be31-a0aef2b9e4b4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.128910] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f78efa9-13fb-4180-9b01-5be62a5cd4c6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.130422] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.130579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.130935] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0ae4a9a-4538-4282-be31-a0aef2b9e4b4 with status ACTIVE [ 1179.131121] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.131269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.131314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.131491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.131579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.131762] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.131876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.131935] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.132250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.132354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.132514] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.132605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.132664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.132803] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.132879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.133024] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0ae4a9a-4538-4282-be31-a0aef2b9e4b4 is going to be updated. [ 1179.151486] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.151630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.151630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.151798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.151924] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.152087] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0ae4a9a-4538-4282-be31-a0aef2b9e4b4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.631857] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f78efa9-13fb-4180-9b01-5be62a5cd4c6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.801595] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e in Status: SUCCESS [ 1179.801836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.002064] env[68109]: INFO networking_nsxv3.common.synchronization [req-14d3609c-0806-45e7-a394-fad5c5f85b45 req-132bc75d-cabe-4e11-ba51-594e6318fbb8 tempest-ServersTestJSON-402636039 tempest-ServersTestJSON-402636039-project-member] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1180.002598] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1180.002902] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.003049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.003120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.003324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.003481] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.003570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.003631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.003775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.003855] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.003953] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.135433] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.135570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.135609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.135813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.135905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.136098] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 is going to be created. [ 1180.159743] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.159908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.160032] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.160197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.160389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.169250] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 in Status: UNINITIALIZED for 2s [ 1180.310833] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.310833] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.310833] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.310977] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.311838] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.311838] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.312305] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.312508] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.313098] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.313390] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.313520] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1180.313682] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1180.313759] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1180.313874] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.313995] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1180.314153] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1180.331688] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1180.331790] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1180.331926] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1180.332157] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.332501] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-bcd6eb8e-0426-49ad-beae-760774262ed3 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.332701] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-bcd6eb8e-0426-49ad-beae-760774262ed3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.332838] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-bcd6eb8e-0426-49ad-beae-760774262ed3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.333430] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-bcd6eb8e-0426-49ad-beae-760774262ed3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.333430] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcd6eb8e-0426-49ad-beae-760774262ed3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.505950] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.835870] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.836270] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.836270] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.837042] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.837042] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.837042] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port bcd6eb8e-0426-49ad-beae-760774262ed3 not found, creating... [ 1180.837294] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.837500] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.837651] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.837919] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.838107] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.838454] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.838635] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.838774] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.839147] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.839355] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.839579] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: bcd6eb8e-0426-49ad-beae-760774262ed3 is going to be created. [ 1180.864007] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.864301] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.864440] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.864741] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.864997] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.865260] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-bcd6eb8e-0426-49ad-beae-760774262ed3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.008351] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.511569] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.511956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.511956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.512139] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.512195] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.512299] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1181.539312] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.539479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.539571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.539709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.539885] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.544689] env[68109]: INFO networking_nsxv3.common.synchronization [req-14d3609c-0806-45e7-a394-fad5c5f85b45 req-0facb686-dc35-4a1c-bfd3-1bb425abefeb service nova] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_rules [ 1181.544882] env[68109]: INFO networking_nsxv3.common.synchronization [req-14d3609c-0806-45e7-a394-fad5c5f85b45 req-0facb686-dc35-4a1c-bfd3-1bb425abefeb service nova] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1181.544998] env[68109]: INFO networking_nsxv3.common.synchronization [req-14d3609c-0806-45e7-a394-fad5c5f85b45 req-0facb686-dc35-4a1c-bfd3-1bb425abefeb service nova] Enqueued Resource ID: bcd6eb8e-0426-49ad-beae-760774262ed3 with Priority: HIGHEST for action port [ 1181.545236] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_rules [ 1181.545379] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1181.545455] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcd6eb8e-0426-49ad-beae-760774262ed3 with Priority: HIGHEST for action port [ 1181.546019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.546123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.546194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.546359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.546417] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.548055] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.548160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.548450] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcd6eb8e-0426-49ad-beae-760774262ed3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.548569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcd6eb8e-0426-49ad-beae-760774262ed3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.548652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcd6eb8e-0426-49ad-beae-760774262ed3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.548794] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcd6eb8e-0426-49ad-beae-760774262ed3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.548870] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcd6eb8e-0426-49ad-beae-760774262ed3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.550776] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1182.049330] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.049657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.050808] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcd6eb8e-0426-49ad-beae-760774262ed3 with status ACTIVE [ 1182.051053] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.051194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.051284] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.051499] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.051592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.051770] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.051892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.051932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.052102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.052180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.052362] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.052456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.052516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.052659] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.052719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.052804] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcd6eb8e-0426-49ad-beae-760774262ed3 is going to be updated. [ 1182.072347] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.072477] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.072565] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.072691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.072812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.073340] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcd6eb8e-0426-49ad-beae-760774262ed3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.186187] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 in Status: SUCCESS [ 1182.186395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.186558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.186768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.186952] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.187082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.187147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.187300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.187382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.187535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.187633] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f78efa9-13fb-4180-9b01-5be62a5cd4c6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.690502] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f78efa9-13fb-4180-9b01-5be62a5cd4c6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.169675] env[68109]: INFO networking_nsxv3.common.synchronization [req-016fcbe3-48fc-448b-924c-64190da5c987 req-d0be2df0-fc8c-4e01-a31d-382023fa517f tempest-AttachVolumeTestJSON-790066154 tempest-AttachVolumeTestJSON-790066154-project-member] Enqueued Resource ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 with Priority: HIGHEST for action security_group_members [ 1183.170195] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 with Priority: HIGHEST for action security_group_members [ 1183.170491] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.170630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.170707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.170948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.171175] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.171267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.171329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.171479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.171562] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.171655] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5921dd09-1c8b-4cd1-8a86-569cea9e50d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.193351] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f78efa9-13fb-4180-9b01-5be62a5cd4c6: rpc.has_security_group_logging(os_id): False [ 1183.209923] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.210069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.210138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.210324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.210413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.210690] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.210814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.210880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.211041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.211121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.211208] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 is going to be created. [ 1183.270391] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.270391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.270391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.270391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.270391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.280793] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 in Status: IN_PROGRESS for 2s [ 1183.439042] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-132 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.439186] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-132" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.439355] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-132" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.439730] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-132" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.440062] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.440271] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.440479] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.440753] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.440965] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.441259] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1183.441432] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1183.441558] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1183.441674] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1183.441795] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1183.441957] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1183.442150] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1183.464945] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1183.465047] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1183.465175] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1183.465359] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-132" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.465946] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-f54a6040-3a0b-4dd9-a6a7-5760ca40da2d taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.466882] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-f54a6040-3a0b-4dd9-a6a7-5760ca40da2d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.466882] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-f54a6040-3a0b-4dd9-a6a7-5760ca40da2d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.466882] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-f54a6040-3a0b-4dd9-a6a7-5760ca40da2d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.466882] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f54a6040-3a0b-4dd9-a6a7-5760ca40da2d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.562671] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1183.562671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.562671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.562671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.562671] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.562671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.562671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.562671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.562671] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.562671] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.673632] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.673836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.673836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.674089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.674191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.674394] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.674492] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.674553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.674707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.674784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.674870] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 already deleted. [ 1183.674950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.969015] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.969331] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.969473] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.969786] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.970041] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.970225] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port f54a6040-3a0b-4dd9-a6a7-5760ca40da2d not found, creating... [ 1183.970506] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.970674] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.970800] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.972186] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.972360] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.972687] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.972895] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.973099] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.973419] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.973608] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.973826] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: f54a6040-3a0b-4dd9-a6a7-5760ca40da2d is going to be created. [ 1183.992693] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.992911] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.993057] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.993347] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.993581] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.993840] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-f54a6040-3a0b-4dd9-a6a7-5760ca40da2d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.064313] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.106078] env[68109]: INFO networking_nsxv3.common.synchronization [req-b0793536-fefc-4136-837a-a849f225a919 req-d8e3d9bb-ebf6-453c-a43c-33f95f52da07 tempest-ServersNegativeTestMultiTenantJSON-168347197 tempest-ServersNegativeTestMultiTenantJSON-168347197-project-member] Enqueued Resource ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e with Priority: HIGHEST for action security_group_members [ 1184.106813] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e with Priority: HIGHEST for action security_group_members [ 1184.106907] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.107455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.107455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.107455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.107455] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.107670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.107670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.107761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.107847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.107948] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32c2ad67-dff8-4ece-b3e8-2d6f1363534e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.566427] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.611312] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.611312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.611312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.611312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.611312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.611312] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.611312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.611666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.611666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.611666] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.611666] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e is going to be updated. [ 1184.637408] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.637590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.637661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.637848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.637980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.646971] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e in Status: IN_PROGRESS for 2s [ 1184.676869] env[68109]: INFO networking_nsxv3.common.synchronization [req-016fcbe3-48fc-448b-924c-64190da5c987 req-4ac80d82-6200-49e9-95d5-1dd5c1385742 service nova] Enqueued Resource ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 with Priority: HIGHEST for action security_group_rules [ 1184.677065] env[68109]: INFO networking_nsxv3.common.synchronization [req-016fcbe3-48fc-448b-924c-64190da5c987 req-4ac80d82-6200-49e9-95d5-1dd5c1385742 service nova] Enqueued Resource ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 with Priority: HIGHEST for action security_group_members [ 1184.677207] env[68109]: INFO networking_nsxv3.common.synchronization [req-016fcbe3-48fc-448b-924c-64190da5c987 req-4ac80d82-6200-49e9-95d5-1dd5c1385742 service nova] Enqueued Resource ID: f54a6040-3a0b-4dd9-a6a7-5760ca40da2d with Priority: HIGHEST for action port [ 1184.677433] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 with Priority: HIGHEST for action security_group_rules [ 1184.677603] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 with Priority: HIGHEST for action security_group_members [ 1184.677708] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54a6040-3a0b-4dd9-a6a7-5760ca40da2d with Priority: HIGHEST for action port [ 1184.678267] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.678407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.678445] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.678782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.678782] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5921dd09-1c8b-4cd1-8a86-569cea9e50d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.679979] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.680058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.680093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.680261] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.680405] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.680497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.680559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.680698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.680775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.680862] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5921dd09-1c8b-4cd1-8a86-569cea9e50d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.682027] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f54a6040-3a0b-4dd9-a6a7-5760ca40da2d taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.682027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f54a6040-3a0b-4dd9-a6a7-5760ca40da2d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.682027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f54a6040-3a0b-4dd9-a6a7-5760ca40da2d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.682027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f54a6040-3a0b-4dd9-a6a7-5760ca40da2d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.682027] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f54a6040-3a0b-4dd9-a6a7-5760ca40da2d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.069095] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.069276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.069352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.069609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.069707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.069812] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1185.096176] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.096330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.096398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.096607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.096753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.104804] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1185.184136] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.184282] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.184575] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5921dd09-1c8b-4cd1-8a86-569cea9e50d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.185420] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f54a6040-3a0b-4dd9-a6a7-5760ca40da2d with status ACTIVE [ 1185.185575] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.185696] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.185763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.185964] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.186063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.186239] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.186335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.186396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.186553] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.186631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.186805] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.186898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.186958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.187110] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.187183] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.187267] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f54a6040-3a0b-4dd9-a6a7-5760ca40da2d is going to be updated. [ 1185.207583] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.207722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.207791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.207980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.208124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.208275] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f54a6040-3a0b-4dd9-a6a7-5760ca40da2d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.301492] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 in Status: SUCCESS [ 1185.301688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.689730] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5921dd09-1c8b-4cd1-8a86-569cea9e50d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.192214] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.192396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.192481] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.192738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.192836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.192959] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 is going to be created. [ 1186.215695] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.215840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.215904] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.216573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.216573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.226613] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 in Status: UNINITIALIZED for 2s [ 1186.658224] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e in Status: SUCCESS [ 1186.658428] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e deletion is rescheduled due to dependency. [ 1186.658504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.114716] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1187.115134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.115134] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.115352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.115714] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.115851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.115923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.116117] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.116206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.116298] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.116391] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.619509] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.619701] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.619741] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.619960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.620148] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.620249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.620312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.620462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.620549] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.620639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.620791] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.620879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.620936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.621090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.621225] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.621316] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.621371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.621507] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.621581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.621664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.621751] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.124016] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 025fe221-7ef8-4d28-bdd2-f925cbbe673c: rpc.has_security_group_logging(os_id): False [ 1188.141120] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.141120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.141301] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.141426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.141484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.141761] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.141972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.141972] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.142096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.142096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.142303] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.142385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.142436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.142578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.142653] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.142827] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.142982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.142982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.143116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.143178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.143268] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1188.198250] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.198486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.198584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.198856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.199105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.210689] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1188.234980] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 in Status: SUCCESS [ 1188.235242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.235377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.235602] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.235784] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.235901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.235968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.236190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.236243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.236300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.236421] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5921dd09-1c8b-4cd1-8a86-569cea9e50d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.738627] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5921dd09-1c8b-4cd1-8a86-569cea9e50d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.245809] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5921dd09-1c8b-4cd1-8a86-569cea9e50d1: rpc.has_security_group_logging(os_id): False [ 1189.262764] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.262910] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.262984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.263207] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.263296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.263534] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.263633] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.263698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.263849] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.263924] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.264061] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 is going to be created. [ 1189.321995] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.322431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.322431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.322558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.322695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.336549] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 in Status: IN_PROGRESS for 2s [ 1189.679556] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1189.679697] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1190.222013] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1190.222246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.348247] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 in Status: SUCCESS [ 1191.348693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.649781] env[68109]: INFO networking_nsxv3.common.synchronization [req-9841ce13-d510-413c-ba04-1a1caef7750b req-c9d0e36d-5c97-4bc3-97c7-bff8ddbbae19 tempest-ServersTestJSON-402636039 tempest-ServersTestJSON-402636039-project-member] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1194.650342] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1194.650646] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.650772] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.650840] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.651048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.651205] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.651304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.651365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.651516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.651598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.651727] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.153937] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.656519] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.161100] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.161100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.161100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.161100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.161100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.161100] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1196.186935] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.187533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.187610] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.187783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.187934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.195996] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1198.206826] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1198.207169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.651419] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1199.651889] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1203.856600] env[68109]: INFO networking_nsxv3.common.synchronization [req-0837c962-ce18-401f-9f26-1f296406e3c5 req-d69b44fb-e5a1-47f6-95a7-82f0ed71f9df tempest-ServersTestJSON-402636039 tempest-ServersTestJSON-402636039-project-member] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1203.856908] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1203.857188] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.857313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.857382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.857571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.857754] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.857908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.857966] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.858209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.858300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.858397] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.106653] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.106653] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.106653] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.106653] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.106960] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.107136] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.107266] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.107486] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.107641] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.107901] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1204.108031] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1204.108149] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1204.108264] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1204.108379] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1204.108488] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1204.108624] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1204.128104] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1204.128270] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1204.128410] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1204.128584] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.128880] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-848dc59c-fe27-4214-acd2-12d4656dbd8f taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.129057] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-848dc59c-fe27-4214-acd2-12d4656dbd8f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.129183] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-848dc59c-fe27-4214-acd2-12d4656dbd8f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.129526] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-848dc59c-fe27-4214-acd2-12d4656dbd8f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.129672] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('848dc59c-fe27-4214-acd2-12d4656dbd8f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.360935] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.632664] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.632902] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.633043] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.633696] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.634371] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.634371] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 848dc59c-fe27-4214-acd2-12d4656dbd8f not found, creating... [ 1204.634371] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.634623] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.634751] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.635068] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.635240] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.635620] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.635986] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.636065] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.636285] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.636460] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.636634] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 848dc59c-fe27-4214-acd2-12d4656dbd8f is going to be created. [ 1204.656968] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.657231] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.657362] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.658087] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.658339] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.658566] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-848dc59c-fe27-4214-acd2-12d4656dbd8f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.862352] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.012749] env[68109]: INFO networking_nsxv3.common.synchronization [req-fddb5089-e7ae-4cba-867c-7236cbb75220 req-5b4ad497-d03c-42a6-bce9-1c7ffe7d4d05 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 with Priority: HIGHEST for action security_group_members [ 1205.013281] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 with Priority: HIGHEST for action security_group_members [ 1205.013580] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-808f3a38-1a93-411e-a57b-76c6b18b7c52 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.013701] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.013765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.013957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.014126] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.014226] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.014286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.014437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.014520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.014614] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('808f3a38-1a93-411e-a57b-76c6b18b7c52',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.324172] env[68109]: INFO networking_nsxv3.common.synchronization [req-0837c962-ce18-401f-9f26-1f296406e3c5 req-f7e4e9a4-459f-411d-910a-0a58cd5d5dc3 service nova] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_rules [ 1205.324401] env[68109]: INFO networking_nsxv3.common.synchronization [req-0837c962-ce18-401f-9f26-1f296406e3c5 req-f7e4e9a4-459f-411d-910a-0a58cd5d5dc3 service nova] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1205.324518] env[68109]: INFO networking_nsxv3.common.synchronization [req-0837c962-ce18-401f-9f26-1f296406e3c5 req-f7e4e9a4-459f-411d-910a-0a58cd5d5dc3 service nova] Enqueued Resource ID: 848dc59c-fe27-4214-acd2-12d4656dbd8f with Priority: HIGHEST for action port [ 1205.324758] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_rules [ 1205.324885] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1205.324981] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848dc59c-fe27-4214-acd2-12d4656dbd8f with Priority: HIGHEST for action port [ 1205.325544] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.325737] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.325737] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.325928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.326017] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.327069] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.327329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.329787] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-848dc59c-fe27-4214-acd2-12d4656dbd8f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.329787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-848dc59c-fe27-4214-acd2-12d4656dbd8f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.329923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-848dc59c-fe27-4214-acd2-12d4656dbd8f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.333333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-848dc59c-fe27-4214-acd2-12d4656dbd8f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.333333] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('848dc59c-fe27-4214-acd2-12d4656dbd8f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.364332] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.364601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.364601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.364750] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.364838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.364936] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1205.409563] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.409814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.409814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.409994] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.410159] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.419344] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1205.516524] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.516681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.516753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.516973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.537128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.537366] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.537480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.537545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.537825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.537942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.538055] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 is going to be updated. [ 1205.561962] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.562095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.562161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.562335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.562463] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.569990] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 in Status: IN_PROGRESS for 2s [ 1205.833794] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.833957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.835309] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 848dc59c-fe27-4214-acd2-12d4656dbd8f with status ACTIVE [ 1205.835495] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.835612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.835869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.835869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.835997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.836145] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.836242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.836310] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.836447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.836523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.836720] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.836820] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.836872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.836986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.837072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.837160] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 848dc59c-fe27-4214-acd2-12d4656dbd8f is going to be updated. [ 1205.859607] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.859607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.859607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.859607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.859607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.859868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-848dc59c-fe27-4214-acd2-12d4656dbd8f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.433676] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1207.433955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.434087] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.434304] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.434493] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.434611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.434673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.434819] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.434902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.434997] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.580212] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 in Status: SUCCESS [ 1207.580378] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 deletion is rescheduled due to dependency. [ 1207.580490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.937723] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.440416] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.943476] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.943729] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.943729] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.943871] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.944121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.944279] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1208.975367] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.975721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.975721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.975876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.976083] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.984188] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1210.326745] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1210.327050] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1210.994904] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1210.995423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.995754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.996085] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.997021] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.997021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.997021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.997021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.997021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.997021] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.997021] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.499809] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.500137] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.500137] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.500273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.500464] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.500580] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.500646] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.500799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.500886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.500976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.501143] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.501237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.501298] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.501435] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.501568] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.501657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.501716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.501848] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.501926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.502029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.502144] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.005111] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 025fe221-7ef8-4d28-bdd2-f925cbbe673c: rpc.has_security_group_logging(os_id): False [ 1212.022498] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.022734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.022734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.022927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.023027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.023248] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.023356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.023396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.023578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.023655] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.023840] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.023938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.023993] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.024153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.024227] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.024402] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.024493] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.024554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.024690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.024764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.024850] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1212.082186] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.082366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.082366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.082519] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.082665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.096285] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1214.112057] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1214.112435] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.328082] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1215.328351] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1215.733546] env[68109]: INFO networking_nsxv3.common.synchronization [req-ab42767e-f0f5-4a00-92b2-959970914c5f req-e222b295-40c3-4564-9c63-054615daca86 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_members [ 1215.733638] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_members [ 1215.733923] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.734141] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.734224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.734419] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.734574] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.734676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.734731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.734876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.735023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.735067] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.993420] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.993639] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.993754] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.994090] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.994420] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.994587] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.994710] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.994940] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.995109] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.995341] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1215.995571] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1215.995616] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1215.995900] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1215.995900] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1215.996066] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1215.996120] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1216.013807] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1216.014500] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1216.014500] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1216.014500] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.014617] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-0eed5405-0c98-4b82-b937-27bf2b2b64ad taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.014740] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-0eed5405-0c98-4b82-b937-27bf2b2b64ad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.014865] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-0eed5405-0c98-4b82-b937-27bf2b2b64ad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.015193] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-0eed5405-0c98-4b82-b937-27bf2b2b64ad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.015339] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eed5405-0c98-4b82-b937-27bf2b2b64ad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.230919] env[68109]: INFO networking_nsxv3.common.synchronization [req-4d6b416d-e790-4997-97e1-2dc4ef6fc243 req-b5ccf951-fdfa-47b3-8376-240237dd6f2b tempest-ServersTestJSON-402636039 tempest-ServersTestJSON-402636039-project-member] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1216.231458] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1216.231787] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.231913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.231999] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.232210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.232359] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.232455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.232519] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.232657] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.232739] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.232832] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.237182] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.237283] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.237354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.237489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.259886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.260139] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.260283] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.260370] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.260557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.260662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.260829] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c is going to be updated. [ 1216.282572] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.282700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.282771] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.282971] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.283124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.291551] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c in Status: IN_PROGRESS for 2s [ 1216.518035] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.518350] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.518350] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.518550] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.518763] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.518959] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 0eed5405-0c98-4b82-b937-27bf2b2b64ad not found, creating... [ 1216.519280] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.519489] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.519640] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.519906] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.520111] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.520443] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.520614] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.520739] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.520953] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.521109] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.521256] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 0eed5405-0c98-4b82-b937-27bf2b2b64ad is going to be created. [ 1216.540252] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.540469] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.540569] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.541846] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.541846] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.541846] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-0eed5405-0c98-4b82-b937-27bf2b2b64ad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.734683] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.237535] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.423377] env[68109]: INFO networking_nsxv3.common.synchronization [req-ab42767e-f0f5-4a00-92b2-959970914c5f req-bc02a5d9-76a4-4f50-b07e-4e248095db9f service nova] Enqueued Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_rules [ 1217.423587] env[68109]: INFO networking_nsxv3.common.synchronization [req-ab42767e-f0f5-4a00-92b2-959970914c5f req-bc02a5d9-76a4-4f50-b07e-4e248095db9f service nova] Enqueued Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_members [ 1217.423724] env[68109]: INFO networking_nsxv3.common.synchronization [req-ab42767e-f0f5-4a00-92b2-959970914c5f req-bc02a5d9-76a4-4f50-b07e-4e248095db9f service nova] Enqueued Resource ID: 0eed5405-0c98-4b82-b937-27bf2b2b64ad with Priority: HIGHEST for action port [ 1217.423956] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_rules [ 1217.424100] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_members [ 1217.424197] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eed5405-0c98-4b82-b937-27bf2b2b64ad with Priority: HIGHEST for action port [ 1217.424731] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.424856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.424923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.425822] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.426551] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.428116] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.428116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.428116] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eed5405-0c98-4b82-b937-27bf2b2b64ad taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.428116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eed5405-0c98-4b82-b937-27bf2b2b64ad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.428116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eed5405-0c98-4b82-b937-27bf2b2b64ad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.428484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eed5405-0c98-4b82-b937-27bf2b2b64ad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.428484] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eed5405-0c98-4b82-b937-27bf2b2b64ad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.739054] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.739405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.739405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.739529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.739595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.739707] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1217.767675] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.767802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.767890] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.768145] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.768289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.777092] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1217.929966] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.930151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.932453] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0eed5405-0c98-4b82-b937-27bf2b2b64ad with status ACTIVE [ 1217.932633] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.932751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.932818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.933070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.933121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.933291] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.933409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.933443] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.933602] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.933687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.933853] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.933946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.934016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.934157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.934229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.934381] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0eed5405-0c98-4b82-b937-27bf2b2b64ad is going to be updated. [ 1217.954275] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.954427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.954473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.954667] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.954802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.954956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eed5405-0c98-4b82-b937-27bf2b2b64ad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.301060] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c in Status: SUCCESS [ 1218.301060] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c deletion is rescheduled due to dependency. [ 1218.301211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.302055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.302055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.302055] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.302055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.302055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.302055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.302055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.302430] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.478577] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-535 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.478789] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.478933] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.479221] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.479490] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.479652] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.479771] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.479991] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.480181] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.481040] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1218.481040] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1218.481040] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1218.481040] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1218.481040] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1218.481040] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1218.481270] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1218.498715] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1218.498882] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1218.499034] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1218.499220] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-535" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.499533] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-ab63e809-e79e-45cf-833f-d475b23b9e97 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.499711] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.499838] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.500114] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.500277] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab63e809-e79e-45cf-833f-d475b23b9e97',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.805453] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.002148] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.002447] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.002596] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.002838] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.003018] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.003330] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.003509] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.003644] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.003881] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.004053] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.004381] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.004544] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.004678] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.004886] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.005049] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.005200] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: ab63e809-e79e-45cf-833f-d475b23b9e97 is going to be updated. [ 1219.025328] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.025520] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.025658] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.025912] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.026130] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.026362] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.308070] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.709932] env[68109]: INFO networking_nsxv3.common.synchronization [req-1926fa6b-ec5a-486f-be98-c4fc1e17e778 req-67879438-0c7d-42ec-9760-0cad80c3010f service nova] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_rules [ 1219.710241] env[68109]: INFO networking_nsxv3.common.synchronization [req-1926fa6b-ec5a-486f-be98-c4fc1e17e778 req-67879438-0c7d-42ec-9760-0cad80c3010f service nova] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 1219.710482] env[68109]: INFO networking_nsxv3.common.synchronization [req-1926fa6b-ec5a-486f-be98-c4fc1e17e778 req-67879438-0c7d-42ec-9760-0cad80c3010f service nova] Enqueued Resource ID: ab63e809-e79e-45cf-833f-d475b23b9e97 with Priority: HIGHEST for action port [ 1219.711194] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_rules [ 1219.711403] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 1219.711641] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab63e809-e79e-45cf-833f-d475b23b9e97 with Priority: HIGHEST for action port [ 1219.711990] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.712184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.712296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.712586] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.712715] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.713781] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.713944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.714072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.714926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.714926] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.714926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.714926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.714926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.714926] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.714926] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.715689] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab63e809-e79e-45cf-833f-d475b23b9e97 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.715689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.715775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.715902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.715977] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab63e809-e79e-45cf-833f-d475b23b9e97',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.785684] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1219.785882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.810675] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.810997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.810997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.811081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.811141] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.811233] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c is going to be updated. [ 1219.836812] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.836948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.837038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.837274] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.837414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.844649] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c in Status: IN_PROGRESS for 2s [ 1220.217440] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.217573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.218934] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.219797] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab63e809-e79e-45cf-833f-d475b23b9e97 with status ACTIVE [ 1220.219982] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.220115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.220180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.220389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.220472] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.220647] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.220745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.220807] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.220979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.221073] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.221259] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.221352] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.221414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.221552] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.221624] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.221706] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab63e809-e79e-45cf-833f-d475b23b9e97 is going to be updated. [ 1220.243019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.243178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.243245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.243432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.243566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.243719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab63e809-e79e-45cf-833f-d475b23b9e97" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.724323] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.225577] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.226069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.226069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.226069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.226069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.226250] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be updated. [ 1221.254360] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.254558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.254641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.254873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.255039] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.265554] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: IN_PROGRESS for 2s [ 1221.853740] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c in Status: SUCCESS [ 1221.853961] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.854138] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.854355] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.854540] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.854691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.854749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.854863] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.854943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.855040] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.855133] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.356924] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.357272] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.357272] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.357351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.357510] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.357622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.357675] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.357813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.357877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.358026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.358170] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.358292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.358350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.358496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.358654] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.358745] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.358814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.358963] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.359078] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.359173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.359270] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.861180] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b323145-eb80-4cd0-b113-05cefe5e7b4c: rpc.has_security_group_logging(os_id): False [ 1222.878116] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.878322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.878322] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.878529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.878619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.878825] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.878913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.878961] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.879137] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.879209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.879413] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.879510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.879569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.879730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.879850] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.880179] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.880323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.880421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.880614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.880743] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.880883] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c is going to be updated. [ 1222.939239] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.939409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.939481] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.939690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.939831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.950901] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c in Status: IN_PROGRESS for 2s [ 1223.275949] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 1223.276255] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.276455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.276685] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.276886] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.277043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.277108] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.277278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.277366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.277463] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.277567] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.779714] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.282315] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 841d58e8-0316-41e3-a855-66ac66e6d9f4: rpc.has_security_group_logging(os_id): False [ 1224.299365] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.299546] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.299611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.299792] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.316316] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.316625] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.316756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.316834] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.317061] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.317183] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.317279] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be updated. [ 1224.368276] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.368432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.368486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.368694] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.368844] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.383087] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: IN_PROGRESS for 2s [ 1224.558967] env[68109]: INFO networking_nsxv3.common.synchronization [req-82869829-68c5-4e77-95b9-ae3575eda052 req-c3cf6fdb-b82a-425c-b7d7-3eca27df3f17 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_members [ 1224.559523] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGHEST for action security_group_members [ 1224.559835] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.560210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.560210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.560298] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.560428] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.560504] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.560588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.561956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.561956] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.561956] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.614728] env[68109]: INFO networking_nsxv3.common.synchronization [req-82869829-68c5-4e77-95b9-ae3575eda052 req-c3cf6fdb-b82a-425c-b7d7-3eca27df3f17 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 0eed5405-0c98-4b82-b937-27bf2b2b64ad with Priority: HIGHEST for action port [ 1224.615308] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eed5405-0c98-4b82-b937-27bf2b2b64ad with Priority: HIGHEST for action port [ 1224.615631] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eed5405-0c98-4b82-b937-27bf2b2b64ad taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.615761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eed5405-0c98-4b82-b937-27bf2b2b64ad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.615817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eed5405-0c98-4b82-b937-27bf2b2b64ad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.616211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eed5405-0c98-4b82-b937-27bf2b2b64ad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.616454] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eed5405-0c98-4b82-b937-27bf2b2b64ad',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.964065] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c in Status: SUCCESS [ 1224.964523] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.064523] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.064758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.064804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.065066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.065188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.065426] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.065529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.065592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.065796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.065882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.066046] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c is going to be updated. [ 1225.092032] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.092246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.092305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.092525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.092716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.101327] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c in Status: IN_PROGRESS for 2s [ 1225.121717] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0eed5405-0c98-4b82-b937-27bf2b2b64ad with status ACTIVE [ 1225.122011] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.122188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.122252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.122456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.122574] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.122785] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.122907] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.122979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.123148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.123249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.123437] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.123563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.123629] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.123811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.123890] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.123978] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0eed5405-0c98-4b82-b937-27bf2b2b64ad is going to be updated. [ 1225.143034] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.143166] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.143166] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.143362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.143533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.143696] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eed5405-0c98-4b82-b937-27bf2b2b64ad" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.196173] env[68109]: INFO networking_nsxv3.common.synchronization [req-7704ecb0-163c-45b6-bc62-dcb01c62ffe4 req-d303ce8b-32aa-4425-8fee-f39fd2068d14 tempest-ServersTestJSON-402636039 tempest-ServersTestJSON-402636039-project-member] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1226.201939] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1226.202724] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.203131] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.205106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.205106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.205106] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.205106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.205106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.205106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.205106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.205106] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.401170] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 1226.401170] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.509066] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.509066] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.509383] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.509383] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.509655] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.509816] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.509937] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.510175] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.510335] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.510583] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.510707] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1226.510823] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1226.510941] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1226.511069] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.511181] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1226.511320] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1226.530030] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1226.530244] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1226.530379] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1226.530572] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.530909] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-36043f04-65b1-4ba7-9f9f-e78409193c74 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.531134] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-36043f04-65b1-4ba7-9f9f-e78409193c74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.532070] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-36043f04-65b1-4ba7-9f9f-e78409193c74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.532070] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-36043f04-65b1-4ba7-9f9f-e78409193c74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.532070] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36043f04-65b1-4ba7-9f9f-e78409193c74',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.709886] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.035224] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.035224] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.035224] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.035224] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.035224] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.035224] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 36043f04-65b1-4ba7-9f9f-e78409193c74 not found, creating... [ 1227.035729] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.035729] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.035844] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.036136] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.036295] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.036670] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.036843] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.036979] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.037226] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.037373] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.037521] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 36043f04-65b1-4ba7-9f9f-e78409193c74 is going to be created. [ 1227.058479] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.058788] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.058903] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.059238] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.059489] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.059732] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-36043f04-65b1-4ba7-9f9f-e78409193c74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.112373] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c in Status: SUCCESS [ 1227.112373] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c deletion is rescheduled due to dependency. [ 1227.112373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.214680] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.716851] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.717074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.717136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.717337] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.717426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.717533] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1227.745028] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.745231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.745231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.746042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.746042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.754264] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1227.794097] env[68109]: INFO networking_nsxv3.common.synchronization [req-7704ecb0-163c-45b6-bc62-dcb01c62ffe4 req-326f3ac9-0048-411a-958f-220e5129ab49 service nova] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_rules [ 1227.794569] env[68109]: INFO networking_nsxv3.common.synchronization [req-7704ecb0-163c-45b6-bc62-dcb01c62ffe4 req-326f3ac9-0048-411a-958f-220e5129ab49 service nova] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1227.794569] env[68109]: INFO networking_nsxv3.common.synchronization [req-7704ecb0-163c-45b6-bc62-dcb01c62ffe4 req-326f3ac9-0048-411a-958f-220e5129ab49 service nova] Enqueued Resource ID: 36043f04-65b1-4ba7-9f9f-e78409193c74 with Priority: HIGHEST for action port [ 1227.794716] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_rules [ 1227.794814] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1227.794910] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36043f04-65b1-4ba7-9f9f-e78409193c74 with Priority: HIGHEST for action port [ 1227.795500] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.795641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.795703] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.795907] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.796021] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.796912] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.797041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.797608] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-36043f04-65b1-4ba7-9f9f-e78409193c74 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.797733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36043f04-65b1-4ba7-9f9f-e78409193c74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.797790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36043f04-65b1-4ba7-9f9f-e78409193c74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.797970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36043f04-65b1-4ba7-9f9f-e78409193c74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.798126] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36043f04-65b1-4ba7-9f9f-e78409193c74',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.300371] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.300852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.300852] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36043f04-65b1-4ba7-9f9f-e78409193c74 with status ACTIVE [ 1228.301030] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.301190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.301439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.301542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.301713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.301906] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.302052] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.302150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.302365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.302525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.302655] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.302818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.302903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.303105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.303190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.303308] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36043f04-65b1-4ba7-9f9f-e78409193c74 is going to be updated. [ 1228.324318] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.324585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.324686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.327489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.327758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.329028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36043f04-65b1-4ba7-9f9f-e78409193c74" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.764179] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1229.764539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.764593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.764922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.765188] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.765393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.765484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.765673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.765796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.765914] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.268400] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.770775] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.273523] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.273715] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.273761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.273973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.274085] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.274191] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1231.299889] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.300081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.300081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.300313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.300458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.307378] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1231.413690] env[68109]: INFO networking_nsxv3.common.synchronization [req-cb28e1a9-bfc5-4fa4-b352-44b628c950e3 req-da2e6de1-4261-409e-b52a-a16f2a4dcda0 tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 with Priority: HIGHEST for action security_group_members [ 1231.414350] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 with Priority: HIGHEST for action security_group_members [ 1231.414716] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.414837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.414915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.415470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.415555] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.415615] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.415669] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.416418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.416418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.416418] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f78efa9-13fb-4180-9b01-5be62a5cd4c6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.917733] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.918036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.918036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.918350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.918475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.918701] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.918804] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.918866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.919031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.919149] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.919243] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 is going to be updated. [ 1231.943581] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.943750] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.943800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.944012] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.944156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.952956] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 in Status: IN_PROGRESS for 2s [ 1233.316484] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1233.316831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.316888] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.317129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.317392] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.317528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.317588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.317725] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.317802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.317889] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.317980] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.821603] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.821767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.821838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.822085] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.822260] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.822370] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.822468] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.822582] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.822668] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.822759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.822906] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.823007] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.823076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.823218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.823353] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.823447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.823521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.823635] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.823707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.823790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.823882] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.963263] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 in Status: SUCCESS [ 1233.963441] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 deletion is rescheduled due to dependency. [ 1233.963554] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.325761] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 025fe221-7ef8-4d28-bdd2-f925cbbe673c: rpc.has_security_group_logging(os_id): False [ 1234.342997] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.343288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.343288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.343432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.343432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.343702] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.343810] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.343873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.344044] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.344128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.344322] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.344419] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.344479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.344621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.344700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.344882] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.344975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.345148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.345332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.345419] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.345498] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1234.398412] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.398603] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.398603] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.398810] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.398952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.412290] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1234.922196] env[68109]: INFO networking_nsxv3.common.synchronization [req-fd5fcacf-5f8d-4b44-8ce6-f32e33d3318d req-90bdefbd-7a6d-4bd4-98dc-66fcb54c25e2 tempest-VolumesAdminNegativeTest-1005465113 tempest-VolumesAdminNegativeTest-1005465113-project-member] Enqueued Resource ID: c0fab535-8220-484b-8563-633eadfcb87c with Priority: HIGHEST for action security_group_members [ 1234.922712] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fab535-8220-484b-8563-633eadfcb87c with Priority: HIGHEST for action security_group_members [ 1234.923024] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fab535-8220-484b-8563-633eadfcb87c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.923166] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.923238] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.923528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.923613] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.923706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.923757] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.923916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.924016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.924117] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fab535-8220-484b-8563-633eadfcb87c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.253940] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-825 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.253940] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-825" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.254142] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-825" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.254378] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-825" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.254754] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.255043] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.255293] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.255681] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.255939] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.256308] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.256525] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1235.256733] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1235.256942] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1235.257214] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.257505] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1235.257698] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1235.275709] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1235.275891] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1235.276058] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1235.276260] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-825" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.276587] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-f2b375f4-1a42-4c0b-8961-e7f47381d3ea taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.276764] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-f2b375f4-1a42-4c0b-8961-e7f47381d3ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.276887] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-f2b375f4-1a42-4c0b-8961-e7f47381d3ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.277330] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-f2b375f4-1a42-4c0b-8961-e7f47381d3ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.277477] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2b375f4-1a42-4c0b-8961-e7f47381d3ea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.427019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.427426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.427426] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.427510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.427594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.427796] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.427900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.427960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.428172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.428299] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.428344] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fab535-8220-484b-8563-633eadfcb87c already deleted. [ 1235.428400] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.780270] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.780507] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.780636] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.780913] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.781093] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.781256] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port f2b375f4-1a42-4c0b-8961-e7f47381d3ea not found, creating... [ 1235.781520] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.781682] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.781803] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.782036] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.782180] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.782466] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.782622] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.782739] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.782947] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.783100] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.783289] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: f2b375f4-1a42-4c0b-8961-e7f47381d3ea is going to be created. [ 1235.801701] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.801886] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.802020] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.802298] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.802514] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.802733] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-f2b375f4-1a42-4c0b-8961-e7f47381d3ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.428606] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1236.428898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.481572] env[68109]: INFO networking_nsxv3.common.synchronization [req-fd5fcacf-5f8d-4b44-8ce6-f32e33d3318d req-0fd0d205-4fa6-43e7-a36d-8926b853cb9b service nova] Enqueued Resource ID: c0fab535-8220-484b-8563-633eadfcb87c with Priority: HIGHEST for action security_group_rules [ 1236.481754] env[68109]: INFO networking_nsxv3.common.synchronization [req-fd5fcacf-5f8d-4b44-8ce6-f32e33d3318d req-0fd0d205-4fa6-43e7-a36d-8926b853cb9b service nova] Enqueued Resource ID: c0fab535-8220-484b-8563-633eadfcb87c with Priority: HIGHEST for action security_group_members [ 1236.481893] env[68109]: INFO networking_nsxv3.common.synchronization [req-fd5fcacf-5f8d-4b44-8ce6-f32e33d3318d req-0fd0d205-4fa6-43e7-a36d-8926b853cb9b service nova] Enqueued Resource ID: f2b375f4-1a42-4c0b-8961-e7f47381d3ea with Priority: HIGHEST for action port [ 1236.482157] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fab535-8220-484b-8563-633eadfcb87c with Priority: HIGHEST for action security_group_rules [ 1236.482286] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fab535-8220-484b-8563-633eadfcb87c with Priority: HIGHEST for action security_group_members [ 1236.482381] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2b375f4-1a42-4c0b-8961-e7f47381d3ea with Priority: HIGHEST for action port [ 1236.482934] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0fab535-8220-484b-8563-633eadfcb87c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.483250] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.483347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.483823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.483915] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0fab535-8220-484b-8563-633eadfcb87c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.486110] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fab535-8220-484b-8563-633eadfcb87c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.486243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.486313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.486567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.486721] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.486814] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.486888] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.487029] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.487161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.487250] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fab535-8220-484b-8563-633eadfcb87c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.487963] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2b375f4-1a42-4c0b-8961-e7f47381d3ea taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.488070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2b375f4-1a42-4c0b-8961-e7f47381d3ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.488193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2b375f4-1a42-4c0b-8961-e7f47381d3ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.488374] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2b375f4-1a42-4c0b-8961-e7f47381d3ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.488440] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2b375f4-1a42-4c0b-8961-e7f47381d3ea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.531788] env[68109]: INFO networking_nsxv3.common.synchronization [req-545c5fae-dd5e-492a-b74b-a9e209c1a9a3 req-d8f64432-73a4-44aa-8646-0821ccd7b2c2 tempest-ServerActionsTestOtherB-1748290489 tempest-ServerActionsTestOtherB-1748290489-project-member] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 1236.532298] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGHEST for action security_group_members [ 1236.532605] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.532729] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.532800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.532987] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.533158] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.533285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.533346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.533465] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.534027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.534027] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.990499] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fab535-8220-484b-8563-633eadfcb87c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.990633] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.990838] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0fab535-8220-484b-8563-633eadfcb87c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.991936] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2b375f4-1a42-4c0b-8961-e7f47381d3ea with status ACTIVE [ 1236.992033] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.992094] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.992126] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.992561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.992561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.992561] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.992764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.992764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.992902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.992962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.993182] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.993285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.993285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.993455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.993536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.993623] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2b375f4-1a42-4c0b-8961-e7f47381d3ea is going to be updated. [ 1237.014045] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.014181] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.014181] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.014321] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.014450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.014598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2b375f4-1a42-4c0b-8961-e7f47381d3ea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.035886] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.036010] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.036085] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.036253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.036335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.036505] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.036601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.036662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.036800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.036873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.036957] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be updated. [ 1237.061250] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.061368] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.061437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.061598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.061726] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.069581] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: IN_PROGRESS for 2s [ 1237.495194] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0fab535-8220-484b-8563-633eadfcb87c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.997683] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.997851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.997893] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.998135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.998286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.998392] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fab535-8220-484b-8563-633eadfcb87c is going to be created. [ 1238.024687] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.024870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.024916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.025114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.025278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.038594] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fab535-8220-484b-8563-633eadfcb87c in Status: UNINITIALIZED for 2s [ 1239.081028] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 in Status: SUCCESS [ 1239.081490] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 deletion is rescheduled due to dependency. [ 1239.081490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.048262] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fab535-8220-484b-8563-633eadfcb87c in Status: SUCCESS [ 1240.049038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.049038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.049038] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.049232] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.049296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.049346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.049527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.049607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.049695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.049787] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0fab535-8220-484b-8563-633eadfcb87c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.207938] env[68109]: INFO networking_nsxv3.common.synchronization [req-9ea0cc62-216e-4891-9e66-72f29590a7e8 req-795cfd11-e0a5-4b1d-9316-5a0f694104bc tempest-ServersTestJSON-402636039 tempest-ServersTestJSON-402636039-project-member] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1240.207938] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1240.207938] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.207938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.207938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.207938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.207938] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.207938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.207938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.207938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.207938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.207938] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.500705] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.500940] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.501060] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.501356] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.501669] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.501836] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.501956] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.502369] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.502443] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.502610] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1240.502750] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1240.502865] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1240.502979] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1240.503113] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1240.503257] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1240.503430] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1240.523702] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1240.523841] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1240.523943] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1240.524239] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.524639] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-543ae45d-74aa-4239-90a7-a4a514f8dd6e taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.524869] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-543ae45d-74aa-4239-90a7-a4a514f8dd6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.525139] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-543ae45d-74aa-4239-90a7-a4a514f8dd6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.526077] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-543ae45d-74aa-4239-90a7-a4a514f8dd6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.526077] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('543ae45d-74aa-4239-90a7-a4a514f8dd6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.553744] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fab535-8220-484b-8563-633eadfcb87c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.554069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.554189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.554428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.554729] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.554882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.554977] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.555171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.555302] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.555401] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.555590] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fab535-8220-484b-8563-633eadfcb87c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.555687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.555758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.555891] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.556164] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.556266] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.556330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.556480] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.556559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.556690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.556787] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0fab535-8220-484b-8563-633eadfcb87c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.710638] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.028721] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.028954] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.029038] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.029393] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.029586] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.029752] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 543ae45d-74aa-4239-90a7-a4a514f8dd6e not found, creating... [ 1241.030024] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.030208] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.030325] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.030551] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.030693] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.030988] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.031244] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.031372] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.031585] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.031725] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.031868] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 543ae45d-74aa-4239-90a7-a4a514f8dd6e is going to be created. [ 1241.052847] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.053042] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.053151] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.053385] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.053616] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.053837] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-543ae45d-74aa-4239-90a7-a4a514f8dd6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.059241] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0fab535-8220-484b-8563-633eadfcb87c: rpc.has_security_group_logging(os_id): False [ 1241.076622] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.076622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.076622] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.076878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.076878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.077019] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.078030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.078030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.078030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.078030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.078030] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.078030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.078030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.078030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.078030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.078556] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.078556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.078556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.078556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.078556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.078742] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0fab535-8220-484b-8563-633eadfcb87c is going to be created. [ 1241.148642] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.148858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.148858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.149075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.149272] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.173508] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0fab535-8220-484b-8563-633eadfcb87c in Status: IN_PROGRESS for 2s [ 1241.212977] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.717212] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.717212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.717212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.717212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.717212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.717212] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1241.744454] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.744625] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.744679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.744867] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.745018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.752829] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1241.811671] env[68109]: INFO networking_nsxv3.common.synchronization [req-9ea0cc62-216e-4891-9e66-72f29590a7e8 req-fb39ce6e-fd79-4806-ac4f-04b938cbd747 service nova] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_rules [ 1241.811918] env[68109]: INFO networking_nsxv3.common.synchronization [req-9ea0cc62-216e-4891-9e66-72f29590a7e8 req-fb39ce6e-fd79-4806-ac4f-04b938cbd747 service nova] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1241.812023] env[68109]: INFO networking_nsxv3.common.synchronization [req-9ea0cc62-216e-4891-9e66-72f29590a7e8 req-fb39ce6e-fd79-4806-ac4f-04b938cbd747 service nova] Enqueued Resource ID: 543ae45d-74aa-4239-90a7-a4a514f8dd6e with Priority: HIGHEST for action port [ 1241.812247] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_rules [ 1241.812371] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1241.812469] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 543ae45d-74aa-4239-90a7-a4a514f8dd6e with Priority: HIGHEST for action port [ 1241.812998] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.813135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.813199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.813393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.813473] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.814591] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.820102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.820102] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-543ae45d-74aa-4239-90a7-a4a514f8dd6e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.820102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-543ae45d-74aa-4239-90a7-a4a514f8dd6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.820102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-543ae45d-74aa-4239-90a7-a4a514f8dd6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.820102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-543ae45d-74aa-4239-90a7-a4a514f8dd6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.820102] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('543ae45d-74aa-4239-90a7-a4a514f8dd6e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.316547] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.316920] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.320065] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 543ae45d-74aa-4239-90a7-a4a514f8dd6e with status ACTIVE [ 1242.320407] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.320600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.320711] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.321043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.321151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.321334] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.321434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.321497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.321661] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.321784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.322037] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.322139] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.322222] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.322391] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.322470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.322557] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 543ae45d-74aa-4239-90a7-a4a514f8dd6e is going to be updated. [ 1242.347759] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.347941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.347984] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.348274] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.348454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.348598] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-543ae45d-74aa-4239-90a7-a4a514f8dd6e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.187771] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0fab535-8220-484b-8563-633eadfcb87c in Status: SUCCESS [ 1243.188104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.762407] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1243.762766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.762766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.762976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.763178] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.763319] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.763387] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.763547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.763630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.763728] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.998926] env[68109]: INFO networking_nsxv3.common.synchronization [req-e17c52d7-0c38-4a21-a481-31a58e7ef200 req-1c625b0c-8f98-4a48-934d-7513a46c60e0 tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c with Priority: HIGHEST for action security_group_members [ 1243.999721] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c with Priority: HIGHEST for action security_group_members [ 1244.000049] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.000388] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.000388] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.000571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.000571] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.000652] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.000719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.000860] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.000985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.001045] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fef5c6c-c6aa-4088-93a6-194fafd50d0c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.267333] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.502625] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.502778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.502849] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.503157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.524148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.524548] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.524548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.524670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.524831] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.524916] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.525017] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c is going to be updated. [ 1244.547915] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.548148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.548278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.548577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.548790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.557754] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c in Status: IN_PROGRESS for 2s [ 1244.770196] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.275307] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.275307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.275307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.275307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.275307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.275307] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1245.304256] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.304401] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.304473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.304673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.304811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.314758] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1246.567906] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c in Status: SUCCESS [ 1246.568343] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c deletion is rescheduled due to dependency. [ 1246.568343] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.325598] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1247.325796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.326043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.326377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.326613] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.326737] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.326820] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.327015] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.327118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.327211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.327314] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.829956] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.830351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.830351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.830423] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.830573] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.830697] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.830763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.830923] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.831016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.831106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.831256] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.831350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.831410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.831548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.831679] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.831768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.831827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.831960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.832041] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.832122] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.832211] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.286850] env[68109]: INFO networking_nsxv3.common.synchronization [req-d078a5df-138f-4b42-bb05-8a101079671b req-1127c5f1-8c95-464d-bb1a-41748018b179 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_members [ 1248.288854] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_members [ 1248.288854] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.288854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.288854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.288854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.288854] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.288854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.288854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.288854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.288854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.289678] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.334992] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 025fe221-7ef8-4d28-bdd2-f925cbbe673c: rpc.has_security_group_logging(os_id): False [ 1248.352966] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.353163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.353219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.353486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.353596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.354219] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.354219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.354219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.354525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.354721] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.354878] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.355023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.355077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.355236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.355324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.355515] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.355621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.355683] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.355862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.355932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.356025] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1248.411485] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.411654] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.411696] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.411899] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.412062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.426217] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1248.603963] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.604330] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.604564] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.604972] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.605403] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.605684] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.605910] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.606299] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.606565] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.606912] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1248.607153] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1248.607380] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1248.607604] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1248.607832] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1248.608064] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1248.608337] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1248.626430] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1248.626595] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1248.626755] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1248.626951] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-465" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.627293] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-b77c9b0a-8f60-4682-acca-45df8d966ead taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.627467] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-b77c9b0a-8f60-4682-acca-45df8d966ead" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.627590] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-b77c9b0a-8f60-4682-acca-45df8d966ead" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.627916] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-b77c9b0a-8f60-4682-acca-45df8d966ead" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.628066] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b77c9b0a-8f60-4682-acca-45df8d966ead',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.790848] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.131039] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.131293] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.131494] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.131711] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.131866] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.132034] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port b77c9b0a-8f60-4682-acca-45df8d966ead not found, creating... [ 1249.132306] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.132469] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.132592] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.132813] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.132970] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.133250] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.133410] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.133533] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.133869] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.133869] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.134086] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: b77c9b0a-8f60-4682-acca-45df8d966ead is going to be created. [ 1249.152565] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.152785] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.152914] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.153222] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.153491] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.153729] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-b77c9b0a-8f60-4682-acca-45df8d966ead" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.292801] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.404242] env[68109]: INFO networking_nsxv3.common.synchronization [req-ef9dbbb5-0474-420c-8843-5138f39cd5c9 req-5b7e7485-e18c-46b8-b006-8e4d9cc3497a tempest-VolumesAdminNegativeTest-1005465113 tempest-VolumesAdminNegativeTest-1005465113-project-member] Enqueued Resource ID: c0fab535-8220-484b-8563-633eadfcb87c with Priority: HIGHEST for action security_group_members [ 1249.404780] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fab535-8220-484b-8563-633eadfcb87c with Priority: HIGHEST for action security_group_members [ 1249.405115] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fab535-8220-484b-8563-633eadfcb87c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.405243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.405312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.405524] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.405685] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.405786] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.405851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.406152] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.406312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.406438] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fab535-8220-484b-8563-633eadfcb87c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.797078] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.797291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.797370] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.797708] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.797754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.797869] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 is going to be updated. [ 1249.824158] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.824158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.824158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.824393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.825026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.834371] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: IN_PROGRESS for 2s [ 1249.873533] env[68109]: INFO networking_nsxv3.common.synchronization [None req-7572ed19-9606-4705-b69f-e015c95b6b49 tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGHEST for action security_group_rules [ 1249.874094] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGHEST for action security_group_rules [ 1249.874402] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.874511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.874595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.874863] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.874964] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5160f4a4-8bae-41f0-ba62-9c251afc33f5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.908446] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.908621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.908684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.908890] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.908980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.909186] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.909291] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.909362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.909605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.909686] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.909775] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fab535-8220-484b-8563-633eadfcb87c is going to be updated. [ 1249.933418] env[68109]: INFO networking_nsxv3.common.synchronization [req-d078a5df-138f-4b42-bb05-8a101079671b req-a92cca4e-3f54-4d4c-93e7-f3928409756d service nova] Enqueued Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_rules [ 1249.933621] env[68109]: INFO networking_nsxv3.common.synchronization [req-d078a5df-138f-4b42-bb05-8a101079671b req-a92cca4e-3f54-4d4c-93e7-f3928409756d service nova] Enqueued Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_members [ 1249.933768] env[68109]: INFO networking_nsxv3.common.synchronization [req-d078a5df-138f-4b42-bb05-8a101079671b req-a92cca4e-3f54-4d4c-93e7-f3928409756d service nova] Enqueued Resource ID: b77c9b0a-8f60-4682-acca-45df8d966ead with Priority: HIGHEST for action port [ 1249.934778] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.934917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.934980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.935749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.935908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.937668] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_rules [ 1249.937821] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_members [ 1249.941616] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b77c9b0a-8f60-4682-acca-45df8d966ead with Priority: HIGHEST for action port [ 1249.941616] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.941616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.941616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.941616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.941616] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.941616] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.941616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.941616] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-b77c9b0a-8f60-4682-acca-45df8d966ead taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.941616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b77c9b0a-8f60-4682-acca-45df8d966ead" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.941616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b77c9b0a-8f60-4682-acca-45df8d966ead" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.941616] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b77c9b0a-8f60-4682-acca-45df8d966ead" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.941616] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b77c9b0a-8f60-4682-acca-45df8d966ead',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.949587] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fab535-8220-484b-8563-633eadfcb87c in Status: IN_PROGRESS for 2s [ 1249.958050] env[68109]: INFO networking_nsxv3.common.synchronization [None req-c5856403-e848-42cf-9b77-80506fb31c4e tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGHEST for action security_group_rules [ 1249.959096] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGHEST for action security_group_rules [ 1249.959483] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.959620] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.394533] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.394815] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.394815] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.394952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.395063] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.395163] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 already deleted. [ 1250.395247] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.395398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.395568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.395650] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5160f4a4-8bae-41f0-ba62-9c251afc33f5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.440208] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1250.440473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.443264] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.443374] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.443566] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b77c9b0a-8f60-4682-acca-45df8d966ead with status ACTIVE [ 1250.443731] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.443866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.443901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.444092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.444201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.444343] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.444979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.444979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.444979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.444979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.444979] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.444979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.444979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.445460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.445460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.445460] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b77c9b0a-8f60-4682-acca-45df8d966ead is going to be updated. [ 1250.466023] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.466023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.466023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.466023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.466023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.466023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b77c9b0a-8f60-4682-acca-45df8d966ead" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.918658] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.918842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.918882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.919105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.919192] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.919284] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 already deleted. [ 1250.919400] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.843909] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: SUCCESS [ 1251.844201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.844389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.845039] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.845039] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.845039] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.845281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.845281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.845399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.845445] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.959499] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fab535-8220-484b-8563-633eadfcb87c in Status: SUCCESS [ 1251.959674] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fab535-8220-484b-8563-633eadfcb87c deletion is rescheduled due to dependency. [ 1251.959751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.349063] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.851367] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.008730] env[68109]: INFO networking_nsxv3.common.synchronization [req-450adb2b-290f-44b5-aa10-89b677379b5d req-3260835a-083f-410e-87c5-db8baf37816a tempest-ServersTestJSON-402636039 tempest-ServersTestJSON-402636039-project-member] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1253.009381] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1253.009611] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.009735] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.009802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.009995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.010158] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.010256] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.010378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.010539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.010571] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.010689] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.353621] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.353854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.353854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.354113] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.354244] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.354398] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 is going to be updated. [ 1253.381962] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.382180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.382180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.382387] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.382537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.390622] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: IN_PROGRESS for 2s [ 1253.513295] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.015510] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.517567] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.517727] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.517799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.518024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.518135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.518239] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1254.544117] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.544292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.544331] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.544552] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.544676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.552497] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1255.399386] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: SUCCESS [ 1255.399747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.399798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.400108] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.400364] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.400508] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.400597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.400818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.400935] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.401023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.401135] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.903912] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.406755] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c79bef7-bf07-4509-8ec1-1db749783b03: rpc.has_security_group_logging(os_id): False [ 1256.424119] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.424321] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.424371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.424586] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.442283] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.442520] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.442635] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.442701] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.442884] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.442966] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.443072] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 is going to be updated. [ 1256.499370] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.499576] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.499623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.499798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.499941] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.510303] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: IN_PROGRESS for 2s [ 1256.561962] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1256.562196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.642315] env[68109]: INFO networking_nsxv3.common.synchronization [req-a1d28553-3989-4737-b95b-7314d03a12e4 req-fe0b768f-e6af-4ba3-a1f6-f63625060257 tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGHEST for action security_group_members [ 1256.642870] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGHEST for action security_group_members [ 1256.643236] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-5160f4a4-8bae-41f0-ba62-9c251afc33f5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.643385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.643458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.643746] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.643917] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.644760] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.644866] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.645098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.645197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.645293] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5160f4a4-8bae-41f0-ba62-9c251afc33f5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.122303] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.122509] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.122639] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.122904] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.123173] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.123333] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.123456] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.123717] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.123876] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.124090] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1257.124211] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1257.124321] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1257.124431] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1257.124542] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1257.124651] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1257.124776] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1257.142018] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1257.142208] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1257.142356] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1257.142534] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.142843] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-7aef2c9c-a681-4cc7-93bb-bf0a18409c21 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.143058] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-7aef2c9c-a681-4cc7-93bb-bf0a18409c21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.143259] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-7aef2c9c-a681-4cc7-93bb-bf0a18409c21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.143501] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-7aef2c9c-a681-4cc7-93bb-bf0a18409c21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.143646] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7aef2c9c-a681-4cc7-93bb-bf0a18409c21',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.151281] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.151281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.151281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.151281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.151281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.151281] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.151281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.151281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.151281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.151281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.151281] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 already deleted. [ 1257.151281] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.648180] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.648639] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.648639] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.648857] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.649014] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.649179] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 7aef2c9c-a681-4cc7-93bb-bf0a18409c21 not found, creating... [ 1257.649455] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.649628] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.649752] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.649975] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.650133] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.650415] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.650574] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.650693] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.650899] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.651046] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.651192] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 7aef2c9c-a681-4cc7-93bb-bf0a18409c21 is going to be created. [ 1257.670601] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.670817] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.670946] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.671208] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.671433] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.671659] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-7aef2c9c-a681-4cc7-93bb-bf0a18409c21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.482280] env[68109]: INFO networking_nsxv3.common.synchronization [req-a1d28553-3989-4737-b95b-7314d03a12e4 req-99a381f0-87b2-464f-ada1-09aaec56ce73 service nova] Enqueued Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGHEST for action security_group_rules [ 1258.482430] env[68109]: INFO networking_nsxv3.common.synchronization [req-a1d28553-3989-4737-b95b-7314d03a12e4 req-99a381f0-87b2-464f-ada1-09aaec56ce73 service nova] Enqueued Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGHEST for action security_group_members [ 1258.482580] env[68109]: INFO networking_nsxv3.common.synchronization [req-a1d28553-3989-4737-b95b-7314d03a12e4 req-99a381f0-87b2-464f-ada1-09aaec56ce73 service nova] Enqueued Resource ID: 7aef2c9c-a681-4cc7-93bb-bf0a18409c21 with Priority: HIGHEST for action port [ 1258.482809] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGHEST for action security_group_rules [ 1258.482952] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGHEST for action security_group_members [ 1258.483045] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aef2c9c-a681-4cc7-93bb-bf0a18409c21 with Priority: HIGHEST for action port [ 1258.483581] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.483708] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.483776] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.483971] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.484064] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5160f4a4-8bae-41f0-ba62-9c251afc33f5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.484886] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-5160f4a4-8bae-41f0-ba62-9c251afc33f5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.485007] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.485098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.485278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.485511] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.485674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.485720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.485863] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.485944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.486046] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5160f4a4-8bae-41f0-ba62-9c251afc33f5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.487057] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-7aef2c9c-a681-4cc7-93bb-bf0a18409c21 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.487180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7aef2c9c-a681-4cc7-93bb-bf0a18409c21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.487254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7aef2c9c-a681-4cc7-93bb-bf0a18409c21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.487500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7aef2c9c-a681-4cc7-93bb-bf0a18409c21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.487593] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7aef2c9c-a681-4cc7-93bb-bf0a18409c21',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.523084] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: SUCCESS [ 1258.523253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.989639] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-5160f4a4-8bae-41f0-ba62-9c251afc33f5 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.990030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.991169] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5160f4a4-8bae-41f0-ba62-9c251afc33f5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.992082] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7aef2c9c-a681-4cc7-93bb-bf0a18409c21 with status ACTIVE [ 1258.992288] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.992418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.992491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.992691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.992779] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.992952] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.993067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.993130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.993282] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.993357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.993556] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.993655] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.993719] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.993859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.993932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.994028] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7aef2c9c-a681-4cc7-93bb-bf0a18409c21 is going to be updated. [ 1259.014553] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.014706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.014747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.014932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.015073] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.015229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7aef2c9c-a681-4cc7-93bb-bf0a18409c21" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.496155] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5160f4a4-8bae-41f0-ba62-9c251afc33f5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.940923] env[68109]: INFO networking_nsxv3.common.synchronization [req-8a31889f-2981-4099-83ec-f2682e275372 req-926be1dc-6dde-45b4-bc55-3124c3de1eef tempest-VolumesAdminNegativeTest-1005465113 tempest-VolumesAdminNegativeTest-1005465113-project-member] Enqueued Resource ID: 45989221-3dfe-4534-880b-3513e8f84d12 with Priority: HIGHEST for action security_group_members [ 1259.941467] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45989221-3dfe-4534-880b-3513e8f84d12 with Priority: HIGHEST for action security_group_members [ 1259.941769] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-45989221-3dfe-4534-880b-3513e8f84d12 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.941909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.941944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.942143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.942293] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.942393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.942455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.942604] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.942688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.942780] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45989221-3dfe-4534-880b-3513e8f84d12',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.998310] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.998656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.998656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.998806] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.998854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.998924] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 is going to be created. [ 1260.020232] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.020363] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.020407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.020556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.020883] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.029101] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 in Status: UNINITIALIZED for 2s [ 1260.445591] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.445830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.445896] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.446210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.446370] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.446642] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.446796] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.446893] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.448059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.448059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.448059] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45989221-3dfe-4534-880b-3513e8f84d12 is going to be updated. [ 1260.475271] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.475449] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.475496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.475695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.475852] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.483210] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45989221-3dfe-4534-880b-3513e8f84d12 in Status: IN_PROGRESS for 2s [ 1261.178983] env[68109]: INFO networking_nsxv3.common.synchronization [req-9bf39f5d-2cb8-4599-945f-0512e2598760 req-4f2c2c9b-27e4-41a2-a0ae-97c66a2d7faf tempest-ServersTestJSON-402636039 tempest-ServersTestJSON-402636039-project-member] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1261.179541] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1261.179829] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.179938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.180020] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.180506] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.180673] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.180798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.180836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.180973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.181104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.181150] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.683442] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.038151] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 in Status: SUCCESS [ 1262.038382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.038589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.038811] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.039012] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.039135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.039202] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.039574] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.039663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.039754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.039848] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5160f4a4-8bae-41f0-ba62-9c251afc33f5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.185500] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.493897] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45989221-3dfe-4534-880b-3513e8f84d12 in Status: SUCCESS [ 1262.493897] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45989221-3dfe-4534-880b-3513e8f84d12 deletion is rescheduled due to dependency. [ 1262.493897] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.543057] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5160f4a4-8bae-41f0-ba62-9c251afc33f5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.689012] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.689242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.689294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.689483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.689579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.689684] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1262.729536] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.729846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.729846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.729968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.730145] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.740239] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1263.044757] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5160f4a4-8bae-41f0-ba62-9c251afc33f5: rpc.has_security_group_logging(os_id): False [ 1263.069368] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.069674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.069791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.070042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.070142] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.070405] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.070537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.070609] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.070784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.070860] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.070955] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 is going to be created. [ 1263.151081] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.151263] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.151309] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.151511] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.151689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.165346] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 in Status: IN_PROGRESS for 2s [ 1264.749995] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1264.749995] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.176111] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 in Status: SUCCESS [ 1265.176360] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.180556] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1266.180888] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1269.118500] env[68109]: INFO networking_nsxv3.common.synchronization [None req-4a7b1859-9ce4-49af-ad66-efb656fce313 None None] Enqueued Resource ID: 040ee39a-4ead-4700-9bf6-e6c9ea372dba with Priority: HIGHEST for action port [ 1269.121547] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040ee39a-4ead-4700-9bf6-e6c9ea372dba with Priority: HIGHEST for action port [ 1269.121880] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-040ee39a-4ead-4700-9bf6-e6c9ea372dba taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.122014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-040ee39a-4ead-4700-9bf6-e6c9ea372dba" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.122105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-040ee39a-4ead-4700-9bf6-e6c9ea372dba" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.122371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-040ee39a-4ead-4700-9bf6-e6c9ea372dba" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.122449] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('040ee39a-4ead-4700-9bf6-e6c9ea372dba',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.612807] env[68109]: INFO networking_nsxv3.common.synchronization [None req-c56d6725-859d-4291-945c-3be72b52c9be tempest-ServerActionsTestJSON-1240277946 tempest-ServerActionsTestJSON-1240277946-project-member] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_rules [ 1269.612807] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_rules [ 1269.613793] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.613793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.613793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.613793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.613793] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.625117] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 040ee39a-4ead-4700-9bf6-e6c9ea372dba [ 1269.625341] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.625467] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.625536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.625734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.625825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.625921] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:040ee39a-4ead-4700-9bf6-e6c9ea372dba already deleted. [ 1269.625999] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-040ee39a-4ead-4700-9bf6-e6c9ea372dba" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.687107] env[68109]: INFO networking_nsxv3.common.synchronization [None req-5663bcf5-45b4-4e99-a07c-59e121df6746 tempest-ServerActionsTestJSON-1240277946 tempest-ServerActionsTestJSON-1240277946-project-member] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_rules [ 1269.687622] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_rules [ 1269.687931] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.688055] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.139100] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.139428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.139428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.140278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.140393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.140489] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 already deleted. [ 1270.140578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.140777] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.140945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.141044] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.342631] env[68109]: INFO networking_nsxv3.common.synchronization [req-9f3e65c1-3939-49ca-8d1f-1fa7fae861e5 req-5856a497-acce-43e1-8438-1fbcedb7204c tempest-ServersTestJSON-402636039 tempest-ServersTestJSON-402636039-project-member] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1270.343171] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1270.343483] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.343605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.343673] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.344292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.344292] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.344591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.344703] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.345104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.345295] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.345487] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.664286] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.664286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.664286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.664286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.664286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.664286] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 already deleted. [ 1270.664286] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.666055] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.666275] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.666467] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.666692] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.666952] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.667129] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.667252] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.667463] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.667607] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.667818] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1270.667942] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1270.668086] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1270.668205] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1270.668325] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1270.668433] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1270.668585] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1270.692584] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1270.692784] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1270.692895] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1270.693083] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.693470] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.693654] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.693782] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.694131] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.694283] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.848821] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.196662] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.197039] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.197193] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.197525] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.197616] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.197768] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111 not found, creating... [ 1271.198053] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.198219] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.198447] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.198690] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.198923] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.199336] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.199604] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.199797] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.200060] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.200253] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.200431] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111 is going to be created. [ 1271.210897] env[68109]: INFO networking_nsxv3.common.synchronization [None req-2c456298-097a-40ca-a315-c555b3324d2b None None] Enqueued Resource ID: b8fb1748-d6cb-427a-aefc-99b70b243cd8 with Priority: HIGHEST for action port [ 1271.211149] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8fb1748-d6cb-427a-aefc-99b70b243cd8 with Priority: HIGHEST for action port [ 1271.211416] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8fb1748-d6cb-427a-aefc-99b70b243cd8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.211527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8fb1748-d6cb-427a-aefc-99b70b243cd8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.211593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8fb1748-d6cb-427a-aefc-99b70b243cd8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.211801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8fb1748-d6cb-427a-aefc-99b70b243cd8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.211883] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8fb1748-d6cb-427a-aefc-99b70b243cd8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.218697] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.218942] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.219025] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.219233] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.219451] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.219686] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.351290] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.714663] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8fb1748-d6cb-427a-aefc-99b70b243cd8 [ 1271.715031] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.715813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.715813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.715813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.715813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.715813] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8fb1748-d6cb-427a-aefc-99b70b243cd8 already deleted. [ 1271.715813] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8fb1748-d6cb-427a-aefc-99b70b243cd8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.853235] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.853378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.853429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.853612] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.853699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.853798] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1271.881901] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.882065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.882126] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.882323] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.882462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.890199] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1271.900175] env[68109]: INFO networking_nsxv3.common.synchronization [req-9f3e65c1-3939-49ca-8d1f-1fa7fae861e5 req-6891762c-87bb-4676-abec-839c05e2f39a service nova] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_rules [ 1271.900175] env[68109]: INFO networking_nsxv3.common.synchronization [req-9f3e65c1-3939-49ca-8d1f-1fa7fae861e5 req-6891762c-87bb-4676-abec-839c05e2f39a service nova] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1271.900175] env[68109]: INFO networking_nsxv3.common.synchronization [req-9f3e65c1-3939-49ca-8d1f-1fa7fae861e5 req-6891762c-87bb-4676-abec-839c05e2f39a service nova] Enqueued Resource ID: 7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111 with Priority: HIGHEST for action port [ 1271.900312] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_rules [ 1271.900381] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1271.900472] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111 with Priority: HIGHEST for action port [ 1271.902308] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.902308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.902308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.902308] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.902308] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.902733] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.902733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.902916] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.903028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.903097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.903256] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.903329] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.405348] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.405348] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.405348] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111 with status ACTIVE [ 1272.405684] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.405684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.405684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.405849] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.405943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.406222] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.406578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.406578] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.406658] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.406688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.406897] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.407058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.407123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.407289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.407390] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.407498] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111 is going to be updated. [ 1272.430634] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.430828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.430938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.431240] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.431344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.431527] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e5bdc5a-2f0c-47c8-b9eb-eb592e9f9111" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.899704] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1273.900201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.900457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.900789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.901079] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.901228] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.901318] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.901526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.901646] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.901754] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.403904] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.906160] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.124011] env[68109]: INFO networking_nsxv3.common.synchronization [req-e34da8ca-1d79-4c0a-84b8-ba4c691b578c req-e71700a3-8ab5-4f0b-a150-0ba25c48b758 tempest-ServerActionsTestJSON-1240277946 tempest-ServerActionsTestJSON-1240277946-project-member] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1275.124547] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1275.124854] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.125027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.125105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.125305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.125460] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.125559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.125623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.125768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.125856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.125950] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.398850] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-802 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.399095] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.399253] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.399627] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.399942] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.400132] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.400254] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.400481] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.400626] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.400837] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1275.400983] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1275.401135] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1275.401252] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1275.401367] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1275.401474] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1275.401608] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1275.408827] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.408827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.408954] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.409101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.409197] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.409296] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1275.421531] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1275.421531] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1275.421726] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1275.421823] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.422164] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-4d65086c-4d90-4148-9f8c-e612e37d99c5 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.422343] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-4d65086c-4d90-4148-9f8c-e612e37d99c5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.422505] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-4d65086c-4d90-4148-9f8c-e612e37d99c5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.422851] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-4d65086c-4d90-4148-9f8c-e612e37d99c5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.422991] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d65086c-4d90-4148-9f8c-e612e37d99c5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.445993] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.446235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.446327] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.446560] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.446730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.456433] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1275.628670] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.629046] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.629145] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.629483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.629626] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.629924] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.630102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.630212] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.630410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.630495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.630592] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 already deleted. [ 1275.630677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.925833] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.925833] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.926250] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.926289] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.926832] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.926832] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 4d65086c-4d90-4148-9f8c-e612e37d99c5 not found, creating... [ 1275.926832] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.927057] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.927154] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.927427] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.927626] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.927963] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.928168] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.928327] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.928575] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.928765] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.928950] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 4d65086c-4d90-4148-9f8c-e612e37d99c5 is going to be created. [ 1275.948520] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.948784] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.948944] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.949245] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.949510] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.949765] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-4d65086c-4d90-4148-9f8c-e612e37d99c5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.628331] env[68109]: INFO networking_nsxv3.common.synchronization [req-e34da8ca-1d79-4c0a-84b8-ba4c691b578c req-4081c22f-5307-496a-9534-c91a85645b38 service nova] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_rules [ 1276.628540] env[68109]: INFO networking_nsxv3.common.synchronization [req-e34da8ca-1d79-4c0a-84b8-ba4c691b578c req-4081c22f-5307-496a-9534-c91a85645b38 service nova] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1276.628725] env[68109]: INFO networking_nsxv3.common.synchronization [req-e34da8ca-1d79-4c0a-84b8-ba4c691b578c req-4081c22f-5307-496a-9534-c91a85645b38 service nova] Enqueued Resource ID: 4d65086c-4d90-4148-9f8c-e612e37d99c5 with Priority: HIGHEST for action port [ 1276.629257] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_rules [ 1276.629395] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1276.629526] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d65086c-4d90-4148-9f8c-e612e37d99c5 with Priority: HIGHEST for action port [ 1276.629910] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.630082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.630137] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.630324] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.630441] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.631337] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.634797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.634797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.634797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.634797] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.634797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.634797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.634797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.634797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.634797] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.634797] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d65086c-4d90-4148-9f8c-e612e37d99c5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.634797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d65086c-4d90-4148-9f8c-e612e37d99c5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.634797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d65086c-4d90-4148-9f8c-e612e37d99c5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.634797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d65086c-4d90-4148-9f8c-e612e37d99c5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.634797] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d65086c-4d90-4148-9f8c-e612e37d99c5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.135985] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.137040] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.137164] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.137315] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d65086c-4d90-4148-9f8c-e612e37d99c5 with status ACTIVE [ 1277.137476] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.137581] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.137641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.137847] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.137936] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.138136] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.138232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.138294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.138447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.138524] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.138739] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.138832] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.138888] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.139062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.139115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.139203] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d65086c-4d90-4148-9f8c-e612e37d99c5 is going to be updated. [ 1277.159043] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.159195] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.159237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.159399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.159524] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.159677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d65086c-4d90-4148-9f8c-e612e37d99c5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.467926] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1277.468187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.468351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.468583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.468808] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.468944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.469026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.469209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.469285] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.469389] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.469493] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.641307] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.971306] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.971495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.971548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.971728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.971925] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.972044] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.972112] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.972287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.972385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.972477] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.972626] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.972720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.972775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.972914] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.973061] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.973153] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.973208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.973347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.973419] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.973499] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.973592] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.143446] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.143773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.143773] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.143901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.143991] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.144157] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 is going to be created. [ 1278.177590] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.177755] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.177919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.178264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.178526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.190110] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: UNINITIALIZED for 2s [ 1278.476027] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 025fe221-7ef8-4d28-bdd2-f925cbbe673c: rpc.has_security_group_logging(os_id): False [ 1278.494970] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.495205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.495205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.495420] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.495499] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.495717] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.495823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.495886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.496074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.496155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.496330] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.496427] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.496486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.496729] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.496800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.497160] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.497160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.497160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.497294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.497339] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.497416] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1278.570738] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.570738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.570738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.571101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.571101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.583198] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1280.200102] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: SUCCESS [ 1280.200471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.200471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.200679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.200867] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.200986] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.201067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.201225] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.201307] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.201392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.201481] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.597287] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1280.597550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.704361] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.207153] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4a1dac4-1522-4ffc-83a0-0f49e1428151: rpc.has_security_group_logging(os_id): False [ 1281.225635] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.225823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.225823] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.225998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.226089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.226332] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.226433] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.226489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.226662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.226761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.226852] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 is going to be created. [ 1281.283991] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.284278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.284278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.284425] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.284599] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.308682] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: IN_PROGRESS for 2s [ 1281.567627] env[68109]: INFO networking_nsxv3.common.synchronization [req-ddf9210f-2b4c-404a-aa8e-23ebb703aa89 req-cba4418a-a4f0-4d3f-9f3b-47882cc996e2 tempest-ServersTestJSON-402636039 tempest-ServersTestJSON-402636039-project-member] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1281.568188] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1281.568494] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.568617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.568709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.568937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.569226] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.569339] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.569403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.569557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.569642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.569737] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.071672] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.573677] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.075758] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.075948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.076028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.076316] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.076418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.076521] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1283.105466] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.105614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.105660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.105854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.105997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.114321] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1283.322561] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: SUCCESS [ 1283.322561] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.640800] env[68109]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1284.641148] env[68109]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] NSXv3 Agent Agent loop - iteration:3 started [ 1285.123298] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1285.123573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.569538] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1286.569873] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1291.570682] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.571137] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1294.182114] env[68109]: INFO networking_nsxv3.common.synchronization [req-c34e6254-e6d9-48ba-ae69-0c1fba060545 req-415d1bbf-13d9-43e1-a9e2-81b9398bc4d4 tempest-ServersTestJSON-402636039 tempest-ServersTestJSON-402636039-project-member] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1294.182114] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1294.182114] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.182114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.182114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.182114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.182114] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.182114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.182114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.183297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.183524] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.183777] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.456201] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.456289] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.456380] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.456636] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.456938] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.457112] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.457236] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.457468] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.457606] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.457833] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1294.457955] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1294.458092] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1294.458214] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1294.458333] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1294.458441] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1294.458575] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1294.477652] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1294.477824] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1294.477953] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1294.478155] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-734" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.478451] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-4bf43057-d14d-4cb2-a9d6-c748fa544403 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.478618] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-4bf43057-d14d-4cb2-a9d6-c748fa544403" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.478742] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-4bf43057-d14d-4cb2-a9d6-c748fa544403" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.479113] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-4bf43057-d14d-4cb2-a9d6-c748fa544403" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.479264] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bf43057-d14d-4cb2-a9d6-c748fa544403',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.686450] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.981151] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.981376] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.981426] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.981696] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.981846] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.982015] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 4bf43057-d14d-4cb2-a9d6-c748fa544403 not found, creating... [ 1294.982280] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.982436] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.982555] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.982769] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.982904] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.983215] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.983371] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.983487] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.983690] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.983821] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.983960] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 4bf43057-d14d-4cb2-a9d6-c748fa544403 is going to be created. [ 1295.004963] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.005170] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.005294] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.005527] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.005748] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.005961] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-4bf43057-d14d-4cb2-a9d6-c748fa544403" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.188743] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.676246] env[68109]: INFO networking_nsxv3.common.synchronization [req-c34e6254-e6d9-48ba-ae69-0c1fba060545 req-85033fa8-d6de-4f02-8674-00a632bbc150 service nova] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_rules [ 1295.676428] env[68109]: INFO networking_nsxv3.common.synchronization [req-c34e6254-e6d9-48ba-ae69-0c1fba060545 req-85033fa8-d6de-4f02-8674-00a632bbc150 service nova] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1295.676574] env[68109]: INFO networking_nsxv3.common.synchronization [req-c34e6254-e6d9-48ba-ae69-0c1fba060545 req-85033fa8-d6de-4f02-8674-00a632bbc150 service nova] Enqueued Resource ID: 4bf43057-d14d-4cb2-a9d6-c748fa544403 with Priority: HIGHEST for action port [ 1295.676824] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_rules [ 1295.676952] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1295.677059] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bf43057-d14d-4cb2-a9d6-c748fa544403 with Priority: HIGHEST for action port [ 1295.677594] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.677732] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.677790] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.677969] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.678060] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.678881] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.679056] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.679200] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bf43057-d14d-4cb2-a9d6-c748fa544403 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.679374] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bf43057-d14d-4cb2-a9d6-c748fa544403" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.679510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bf43057-d14d-4cb2-a9d6-c748fa544403" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.679681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bf43057-d14d-4cb2-a9d6-c748fa544403" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.679758] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bf43057-d14d-4cb2-a9d6-c748fa544403',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.693120] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.693120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.693120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.693120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.693120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.693120] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1295.724764] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.724949] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.724998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.725182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.725325] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.740344] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1296.181634] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.181878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.181878] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bf43057-d14d-4cb2-a9d6-c748fa544403 with status ACTIVE [ 1296.182075] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.182173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.182235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.182451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.182538] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.182749] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.182827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.182882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.182994] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.183067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.183245] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.183334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.183398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.183533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.183605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.183688] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bf43057-d14d-4cb2-a9d6-c748fa544403 is going to be updated. [ 1296.208873] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.209332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.209332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.209332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.209332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.209607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bf43057-d14d-4cb2-a9d6-c748fa544403" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.751194] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1297.751454] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.751638] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.751872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.752097] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.752246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.752320] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.752510] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.752634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.752737] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.255508] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.757891] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.260363] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.260584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.260584] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.260740] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.260815] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.260911] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1299.291578] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.291817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.291817] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.291966] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.292124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.299727] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1300.678470] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1300.678918] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1301.312750] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1301.312968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.313096] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.313332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.313520] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.313636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.313704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.313854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.313934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.314043] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.314139] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.485665] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.485828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.485908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.486139] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.486244] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.815862] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.816288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.816288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.816288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.816467] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.816573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.816639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.816800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.816906] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.816997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.817160] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.817254] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.817314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.817455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.817589] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.817680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.817742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.817878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.817951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.818045] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.818135] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.988744] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.320054] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 025fe221-7ef8-4d28-bdd2-f925cbbe673c: rpc.has_security_group_logging(os_id): False [ 1302.338440] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.338614] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.338664] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.338838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.338971] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.339195] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.339297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.339359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.339518] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.339597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.339785] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.339880] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.339958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.340122] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.340196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.340382] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.340481] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.340536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.340677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.340750] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.340834] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1302.418168] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.418351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.418392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.418568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.418713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.435298] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1302.490753] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.992969] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1302.993401] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1303.828783] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.829014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.829014] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.829231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.840367] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1303.842534] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.843231] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1303.881589] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.881771] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.881771] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.881960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.892206] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.892841] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1303.892924] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1303.893025] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1303.929341] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.929530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.929530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.929707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.930800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.930954] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1304.013879] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.014259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.014259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.014365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.014574] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.014844] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1304.094200] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.094399] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.094447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.094641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.094938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.095248] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 1304.095345] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'f55a1eeb-30c3-44c5-bd92-57dad54e2585', 'c0fab535-8220-484b-8563-633eadfcb87c', '1c79bef7-bf07-4509-8ec1-1db749783b03', '7188635c-e1c3-4fba-9e1d-f639d22a02e3', '3bcda49a-0e74-4618-bd35-62ff5440bd3b', '5160f4a4-8bae-41f0-ba62-9c251afc33f5', '4a565832-732a-4ead-8829-a1e204cdbc42', '841d58e8-0316-41e3-a855-66ac66e6d9f4', '530264c4-f8bd-43b3-94f9-812deb7104ab', '5921dd09-1c8b-4cd1-8a86-569cea9e50d1', '45989221-3dfe-4534-880b-3513e8f84d12', '808f3a38-1a93-411e-a57b-76c6b18b7c52', '025fe221-7ef8-4d28-bdd2-f925cbbe673c', '690e6efd-f18b-488b-b84c-5caae41cc733', '4fef5c6c-c6aa-4088-93a6-194fafd50d0c', '7573caa0-9f71-40fd-82c3-03fa2ce88dbf', 'f4a1dac4-1522-4ffc-83a0-0f49e1428151', 'e812d957-e1ec-4f99-86c2-485e7c16988a', '817904c7-035a-41ce-bf21-c0db158c7bea', '835f674b-2b51-49ea-acd5-6a176ad00616', 'd063caf8-0f34-48a0-8035-c8a07c90a01c', '256c7a06-cd22-48f9-a904-ae2dd6fec0e8', '9f78efa9-13fb-4180-9b01-5be62a5cd4c6', '327a22ab-0003-41d7-851d-6eba37a2b9dc', '3b323145-eb80-4cd0-b113-05cefe5e7b4c', '7dd7db8b-2c17-4640-bd53-bfb063c83711', '9353334a-e1b0-43d9-9c87-a08b8516326e', 'f76ac522-d413-411a-995f-1682c0fc160f', 'ee121dc7-4686-4564-b58a-255456cf3857', '80fea482-6d64-4937-892c-62371db01817', '3775fbff-3109-41e9-a7b4-71b12133d9f0', '04d6d7e9-ac4d-4788-ab37-9ef94a13367a', '32c2ad67-dff8-4ece-b3e8-2d6f1363534e', '115f89cb-8059-4b36-912a-10de0703affe', 'd2db7fe9-82f8-4d20-b269-363d052050b8', '2a8ad551-9243-4b5e-a0bd-acf823c5b01f', '367414dc-5bb3-4cf0-b02d-c624234144c1', '0f244466-a6a8-4118-96a9-bf22e5d33c96', 'fe094fad-6ec3-4179-88a0-da40e49c0ff5', 'a1b52ab9-23fb-4785-af13-8d3e64d2b62f', '02bc3e4c-0cd7-46a0-8516-a78e344aa1a0'} {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1304.095440] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1304.111724] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.111942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.111942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.112051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.112128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.112219] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1304.112288] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1304.112356] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1304.179748] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.180018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.180018] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.180199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.181289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.181543] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1304.181622] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1304.181695] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1304.181764] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1304.181840] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 1304.181910] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGH for action security_group_rules [ 1304.181989] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0fab535-8220-484b-8563-633eadfcb87c with Priority: HIGH for action security_group_rules [ 1304.182071] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGH for action security_group_rules [ 1304.182134] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGH for action security_group_rules [ 1304.182195] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGH for action security_group_rules [ 1304.182256] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGH for action security_group_rules [ 1304.182317] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGH for action security_group_rules [ 1304.182377] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGH for action security_group_rules [ 1304.182437] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGH for action security_group_rules [ 1304.182498] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 with Priority: HIGH for action security_group_rules [ 1304.182559] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45989221-3dfe-4534-880b-3513e8f84d12 with Priority: HIGH for action security_group_rules [ 1304.182619] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 with Priority: HIGH for action security_group_rules [ 1304.182679] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGH for action security_group_rules [ 1304.182739] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGH for action security_group_rules [ 1304.182800] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c with Priority: HIGH for action security_group_rules [ 1304.182862] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGH for action security_group_rules [ 1304.182922] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGH for action security_group_rules [ 1304.182994] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGH for action security_group_rules [ 1304.183119] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 817904c7-035a-41ce-bf21-c0db158c7bea with Priority: HIGH for action security_group_rules [ 1304.183178] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 835f674b-2b51-49ea-acd5-6a176ad00616 with Priority: HIGH for action security_group_rules [ 1304.183270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.448458] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1304.448579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.681056] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1305.681056] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1305.681056] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 with Priority: HIGH for action security_group_rules [ 1305.681056] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGH for action security_group_rules [ 1305.681056] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a565832-732a-4ead-8829-a1e204cdbc42 with Priority: HIGH for action security_group_rules [ 1305.681056] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c with Priority: HIGH for action security_group_rules [ 1305.681661] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835f674b-2b51-49ea-acd5-6a176ad00616 with Priority: HIGH for action security_group_rules [ 1305.681661] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 817904c7-035a-41ce-bf21-c0db158c7bea with Priority: HIGH for action security_group_rules [ 1305.681661] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e812d957-e1ec-4f99-86c2-485e7c16988a with Priority: HIGH for action security_group_rules [ 1305.681661] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGH for action security_group_rules [ 1305.681790] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690e6efd-f18b-488b-b84c-5caae41cc733 with Priority: HIGH for action security_group_rules [ 1305.681822] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf with Priority: HIGH for action security_group_rules [ 1305.681896] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGH for action security_group_rules [ 1305.681991] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 with Priority: HIGH for action security_group_rules [ 1305.682117] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45989221-3dfe-4534-880b-3513e8f84d12 with Priority: HIGH for action security_group_rules [ 1305.682230] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 with Priority: HIGH for action security_group_rules [ 1305.682322] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 530264c4-f8bd-43b3-94f9-812deb7104ab with Priority: HIGH for action security_group_rules [ 1305.682410] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGH for action security_group_rules [ 1305.682504] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 with Priority: HIGH for action security_group_rules [ 1305.682590] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b with Priority: HIGH for action security_group_rules [ 1305.682769] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fab535-8220-484b-8563-633eadfcb87c with Priority: HIGH for action security_group_rules [ 1305.682908] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 with Priority: HIGH for action security_group_rules [ 1305.683354] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.683532] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.683605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.683890] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.684035] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f55a1eeb-30c3-44c5-bd92-57dad54e2585',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.685202] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.685350] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.685473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.685689] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.685856] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.686799] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a565832-732a-4ead-8829-a1e204cdbc42 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.686988] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.687083] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.687243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.687375] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a565832-732a-4ead-8829-a1e204cdbc42',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.688295] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.688458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.688704] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.688742] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.688847] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fef5c6c-c6aa-4088-93a6-194fafd50d0c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.689608] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-835f674b-2b51-49ea-acd5-6a176ad00616 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.689716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.689810] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.689970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.690092] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('835f674b-2b51-49ea-acd5-6a176ad00616',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.690769] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-817904c7-035a-41ce-bf21-c0db158c7bea taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.690869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.690955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.691147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.691220] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('817904c7-035a-41ce-bf21-c0db158c7bea',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.692037] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e812d957-e1ec-4f99-86c2-485e7c16988a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.692135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.692135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.692294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.692382] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e812d957-e1ec-4f99-86c2-485e7c16988a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.693057] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.693234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.693234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.693446] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.693446] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.694206] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690e6efd-f18b-488b-b84c-5caae41cc733 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.694316] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.694378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.694526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.694593] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690e6efd-f18b-488b-b84c-5caae41cc733',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.695267] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.695368] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.695469] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.695628] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.695697] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7573caa0-9f71-40fd-82c3-03fa2ce88dbf',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.696474] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.696537] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.696631] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.696720] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.696795] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.697628] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-808f3a38-1a93-411e-a57b-76c6b18b7c52 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.697768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.697830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.697953] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.698039] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('808f3a38-1a93-411e-a57b-76c6b18b7c52',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.698762] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45989221-3dfe-4534-880b-3513e8f84d12 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.698846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.698924] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.699109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.699209] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45989221-3dfe-4534-880b-3513e8f84d12',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.699921] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.700109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.700178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.700313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.700391] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5921dd09-1c8b-4cd1-8a86-569cea9e50d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.701137] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-530264c4-f8bd-43b3-94f9-812deb7104ab taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.701273] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.701348] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.701499] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.701598] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('530264c4-f8bd-43b3-94f9-812deb7104ab',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.702442] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.702550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.702644] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.702805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.702876] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5160f4a4-8bae-41f0-ba62-9c251afc33f5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.703666] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-841d58e8-0316-41e3-a855-66ac66e6d9f4 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.703734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.703787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.703937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.704038] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('841d58e8-0316-41e3-a855-66ac66e6d9f4',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.704737] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.704875] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.705110] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.705110] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.705221] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bcda49a-0e74-4618-bd35-62ff5440bd3b',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.706073] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0fab535-8220-484b-8563-633eadfcb87c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.706158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.706193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.706505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.706589] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0fab535-8220-484b-8563-633eadfcb87c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.707325] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.707457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.707545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.707691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.707799] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7188635c-e1c3-4fba-9e1d-f639d22a02e3',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.210333] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-5160f4a4-8bae-41f0-ba62-9c251afc33f5 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.210563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.210563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.210783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.210957] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.211082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.211137] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.211301] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.211392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.211471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.211561] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5160f4a4-8bae-41f0-ba62-9c251afc33f5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.217009] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.217148] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.217216] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.217394] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.217551] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.217648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.217707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.217849] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.217931] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.218028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.218119] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.223026] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.223239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.223239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.223421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.223650] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.223722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.223722] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.223870] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.223952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.224051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.224140] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.225008] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.225125] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.225189] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.225342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.225485] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.225579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.225639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.225884] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.225884] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.225978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.226030] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5921dd09-1c8b-4cd1-8a86-569cea9e50d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.230194] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.230372] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.230489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.230674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.230847] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.230952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.231040] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.231198] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.231288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.231362] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.231574] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.245460] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5921dd09-1c8b-4cd1-8a86-569cea9e50d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.246598] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.246798] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.246856] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.247059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.247220] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.247411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.247411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.247525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.247610] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.247698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.247839] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.247934] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.248030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.248213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.248322] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.248414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.248479] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.248608] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.248684] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.248764] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.248850] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.258053] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5921dd09-1c8b-4cd1-8a86-569cea9e50d1: rpc.has_security_group_logging(os_id): False [ 1306.295923] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.296242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.296242] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.296379] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.298669] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.298825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.299888] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.300042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.300984] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.301157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.302118] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.302259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.303229] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.303367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.304344] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.304478] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.305462] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.305589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.306565] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.306700] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.307664] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.307805] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.308764] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.308902] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.310609] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.311196] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.311320] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.312141] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.312630] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.312756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.313524] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.313976] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.314106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.314872] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.315386] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.315506] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.316293] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.316803] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.316894] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.323108] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1306.323551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.323686] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a565832-732a-4ead-8829-a1e204cdbc42 is going to be deleted. [ 1306.324595] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.324802] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.340414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.340598] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bcda49a-0e74-4618-bd35-62ff5440bd3b is going to be deleted. [ 1306.341403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.341627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.357572] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.357777] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690e6efd-f18b-488b-b84c-5caae41cc733 is going to be deleted. [ 1306.358573] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.358785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.376354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.376517] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f55a1eeb-30c3-44c5-bd92-57dad54e2585 is going to be deleted. [ 1306.377330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.377541] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.401397] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.401575] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7573caa0-9f71-40fd-82c3-03fa2ce88dbf is going to be deleted. [ 1306.402503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.402713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.435075] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.435345] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.436269] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.436428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.437274] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.437435] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.440392] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.440574] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e812d957-e1ec-4f99-86c2-485e7c16988a is going to be deleted. [ 1306.441921] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.442236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.460828] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.460997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.463515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.463703] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45989221-3dfe-4534-880b-3513e8f84d12 is going to be deleted. [ 1306.464952] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.465262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.508037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.508291] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 808f3a38-1a93-411e-a57b-76c6b18b7c52 is going to be deleted. [ 1306.509592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.509859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.569265] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.569458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.603104] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.603380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.604252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.604381] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 835f674b-2b51-49ea-acd5-6a176ad00616 is going to be deleted. [ 1306.605310] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.605557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.617380] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.617569] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.678427] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.678706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.698048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.698581] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fef5c6c-c6aa-4088-93a6-194fafd50d0c is going to be deleted. [ 1306.699267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.699483] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.721418] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5160f4a4-8bae-41f0-ba62-9c251afc33f5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.722638] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.739157] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.757032] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 025fe221-7ef8-4d28-bdd2-f925cbbe673c: rpc.has_security_group_logging(os_id): False [ 1306.799123] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.799297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.811420] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.811603] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.816749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.816959] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7188635c-e1c3-4fba-9e1d-f639d22a02e3 is going to be deleted. [ 1306.817756] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.817998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.841531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.841680] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 530264c4-f8bd-43b3-94f9-812deb7104ab is going to be deleted. [ 1306.842486] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.842695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.878890] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.879123] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.886690] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.886848] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0fab535-8220-484b-8563-633eadfcb87c is going to be deleted. [ 1306.887731] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.887905] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.924723] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.925118] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.925838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.926152] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.926270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.926373] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.926585] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.926668] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.926764] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 is going to be updated. [ 1306.927778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.927975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.953829] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.954080] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.993075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.993304] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 841d58e8-0316-41e3-a855-66ac66e6d9f4 is going to be deleted. [ 1306.994124] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.994377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.994472] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.994594] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bcda49a-0e74-4618-bd35-62ff5440bd3b" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.994749] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.994929] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.994978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.995106] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a565832-732a-4ead-8829-a1e204cdbc42" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.995592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.995744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.995825] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.995962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690e6efd-f18b-488b-b84c-5caae41cc733" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.996108] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.996294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.996351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.996434] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f55a1eeb-30c3-44c5-bd92-57dad54e2585" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.996556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.996693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.996767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.996876] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7573caa0-9f71-40fd-82c3-03fa2ce88dbf" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.996997] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.997146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.997218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.997330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45989221-3dfe-4534-880b-3513e8f84d12" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.997476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.997617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.997691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.997797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e812d957-e1ec-4f99-86c2-485e7c16988a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.997919] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.998068] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.998143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.998251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-808f3a38-1a93-411e-a57b-76c6b18b7c52" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.998371] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.998505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.027445] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.027641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.048442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.048725] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.048849] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.048909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.049174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.049253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.049452] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.050034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.050034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.050034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.050034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.050034] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.050296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.050296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.050296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.050384] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.050472] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1307.051601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.051753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.051753] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.051958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-835f674b-2b51-49ea-acd5-6a176ad00616" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.052067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.052156] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.052235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.052333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fef5c6c-c6aa-4088-93a6-194fafd50d0c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.052503] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.052647] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.052713] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.052826] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7188635c-e1c3-4fba-9e1d-f639d22a02e3" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.052942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.053092] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.087775] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.087916] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 817904c7-035a-41ce-bf21-c0db158c7bea is going to be deleted. [ 1307.089024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.089114] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.089187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.089262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0fab535-8220-484b-8563-633eadfcb87c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.089429] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.089591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.089669] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.089778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-530264c4-f8bd-43b3-94f9-812deb7104ab" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.103780] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.103927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.103982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.104180] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.104329] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.132715] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 in Status: IN_PROGRESS for 2s [ 1307.187740] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.188082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.188082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.188211] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.188260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.188378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-841d58e8-0316-41e3-a855-66ac66e6d9f4" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.205802] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.206031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.206031] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.206239] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.206393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.207949] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.208093] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.208150] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.208297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.208378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.208491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-817904c7-035a-41ce-bf21-c0db158c7bea" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.224225] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5160f4a4-8bae-41f0-ba62-9c251afc33f5: rpc.has_security_group_logging(os_id): False [ 1307.225203] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c79bef7-bf07-4509-8ec1-1db749783b03: rpc.has_security_group_logging(os_id): False [ 1307.240425] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1307.241748] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4a1dac4-1522-4ffc-83a0-0f49e1428151: rpc.has_security_group_logging(os_id): False [ 1307.262654] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.262882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.262882] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.263073] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.292772] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.292967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.294681] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.294681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.344030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.344349] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.344494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.344636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.344723] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.344783] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.344913] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 is going to be updated. [ 1307.345978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.346141] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.393400] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.393713] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.393812] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.393907] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.394179] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.394269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.394391] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 is going to be updated. [ 1307.396067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.396252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.427418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.427747] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.427873] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.427930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.428151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.428235] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.428326] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 is going to be updated. [ 1307.492315] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.492531] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.492586] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.492830] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.493082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.508965] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 in Status: IN_PROGRESS for 2s [ 1307.517731] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.517861] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.518850] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.518850] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.518850] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.522956] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.523076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.523149] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.523330] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.523461] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.538578] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: IN_PROGRESS for 2s [ 1307.541188] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: IN_PROGRESS for 2s [ 1309.147237] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 in Status: SUCCESS [ 1309.147606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.255422] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1309.255640] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.484383] env[68109]: INFO networking_nsxv3.common.synchronization [req-f5072db5-7fa2-4f05-b6b3-9df94e134c2a req-2a4b12ec-7dea-46f3-af7b-428fb256a36f tempest-ServersTestJSON-402636039 tempest-ServersTestJSON-402636039-project-member] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1309.484970] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1309.485292] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.485408] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.485478] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.485670] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.485830] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.485928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.485978] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.486143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.486224] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.486330] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.521879] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 in Status: SUCCESS [ 1309.521879] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.555061] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: SUCCESS [ 1309.555061] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.555381] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: SUCCESS [ 1309.555557] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.990506] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.492677] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.994697] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.994858] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.994975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.995243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.995337] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.995441] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1311.039218] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.039415] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.039516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.039778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.039975] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.048503] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1313.059494] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1313.059838] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.485767] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.486068] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.559533] env[68109]: INFO networking_nsxv3.common.synchronization [req-4ab91def-8af9-46fe-8b14-e3fc667497b5 req-bccbc5ec-89e3-4655-bc24-35f87e9382a3 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_members [ 1315.560020] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_members [ 1315.560334] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.560460] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.560570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.560712] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.560860] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.560959] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.561036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.561188] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.561268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.561369] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.063238] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.565069] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.823855] env[68109]: INFO networking_nsxv3.common.synchronization [req-7653c374-846a-484f-a249-f4bae4eeca14 req-2a2b655b-5da5-4bc5-8888-bf93e00ada7a tempest-ServersTestJSON-402636039 tempest-ServersTestJSON-402636039-project-member] Enqueued Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1316.824475] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c with Priority: HIGHEST for action security_group_members [ 1316.824772] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-025fe221-7ef8-4d28-bdd2-f925cbbe673c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.824892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.824960] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.825172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.825325] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.825417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.825475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.825662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.825751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.825844] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('025fe221-7ef8-4d28-bdd2-f925cbbe673c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.068062] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.068062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.068062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.068062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.068062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.068367] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 is going to be updated. [ 1317.097974] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.098175] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.098175] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.098432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.098574] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.110843] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: IN_PROGRESS for 2s [ 1317.328914] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.329127] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.329225] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.329456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.329548] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.329758] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.329872] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.329937] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.330157] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.330237] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.330337] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c is going to be updated. [ 1317.360511] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.360701] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.360758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.360940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.361104] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.368646] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: IN_PROGRESS for 2s [ 1319.121137] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: SUCCESS [ 1319.121520] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.377396] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c in Status: SUCCESS [ 1319.377692] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 025fe221-7ef8-4d28-bdd2-f925cbbe673c deletion is rescheduled due to dependency. [ 1319.377892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-025fe221-7ef8-4d28-bdd2-f925cbbe673c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.826055] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1321.826447] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1322.339894] env[68109]: INFO networking_nsxv3.common.synchronization [req-e59a7fa7-ca9e-429c-b576-150b616b3593 req-62c70554-006c-4b2e-9845-1f0fc2d96d6b tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGHEST for action security_group_members [ 1322.340598] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGHEST for action security_group_members [ 1322.340942] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-5160f4a4-8bae-41f0-ba62-9c251afc33f5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.341116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.341196] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.341418] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.341605] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.341706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.341776] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.341928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.342024] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.342119] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5160f4a4-8bae-41f0-ba62-9c251afc33f5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.844172] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.844869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.844869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.844869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.844869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.844869] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.845066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.845066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.845251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.845251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.845410] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 is going to be updated. [ 1322.872733] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.872868] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.872927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.873133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.873267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.880700] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 in Status: IN_PROGRESS for 2s [ 1324.892969] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 in Status: SUCCESS [ 1324.893333] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 deletion is rescheduled due to dependency. [ 1324.893333] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.342070] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.342388] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1327.988194] env[68109]: INFO networking_nsxv3.common.synchronization [None req-41a9743c-3d1a-4afa-b1cf-dadd5eb6670e tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 with Priority: HIGHEST for action security_group_rules [ 1327.988194] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 with Priority: HIGHEST for action security_group_rules [ 1327.988194] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.988194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.988194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.988194] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.988194] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5494c64-0d9d-4ed2-b10e-fd2df70e7907',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.050118] env[68109]: INFO networking_nsxv3.common.synchronization [None req-871565c8-510a-4d9c-b566-6b849e301030 tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 with Priority: HIGHEST for action security_group_rules [ 1328.050617] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 with Priority: HIGHEST for action security_group_rules [ 1328.050916] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.051030] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.506684] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.507077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.507077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.507253] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.507388] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.507509] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 already deleted. [ 1328.507613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.507789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.507982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.508107] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5494c64-0d9d-4ed2-b10e-fd2df70e7907',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.026834] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.027040] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.027040] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.028022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.028022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.028022] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 already deleted. [ 1329.028022] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.696891] env[68109]: INFO networking_nsxv3.common.synchronization [req-913097c3-9122-472f-b429-17c26b669050 req-aeb9782c-c4d4-457a-b319-73d449e48179 tempest-AttachVolumeTestJSON-790066154 tempest-AttachVolumeTestJSON-790066154-project-member] Enqueued Resource ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 with Priority: HIGHEST for action security_group_members [ 1331.697432] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 with Priority: HIGHEST for action security_group_members [ 1331.697725] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.700944] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.701334] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.701529] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.703099] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.703099] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.703099] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.703099] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.703099] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.703419] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5921dd09-1c8b-4cd1-8a86-569cea9e50d1',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.144612] env[68109]: INFO networking_nsxv3.common.synchronization [req-79150e36-dce0-4548-90d5-7bb62a18de4c req-c65841f7-f709-4384-9602-3f20b64ef5f4 tempest-ServerActionsTestOtherA-1699162424 tempest-ServerActionsTestOtherA-1699162424-project-member] Enqueued Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_members [ 1332.144856] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGHEST for action security_group_members [ 1332.146955] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.146955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.146955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.146955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.146955] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.146955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.146955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.146955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.146955] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.146955] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.205847] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.206042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.206091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.206280] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.206381] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.206586] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.206688] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.206751] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.206898] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.206973] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.207070] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 is going to be updated. [ 1332.233686] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.233900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.233951] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.234492] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.234492] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.242401] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 in Status: IN_PROGRESS for 2s [ 1332.649417] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.649417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.649417] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.649682] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.650639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.650639] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.650639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.650639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.650639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.650639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.650639] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 is going to be updated. [ 1332.680583] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.680583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.680583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.680801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.680801] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.689457] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: IN_PROGRESS for 2s [ 1333.327475] env[68109]: INFO networking_nsxv3.common.synchronization [req-d0e2ed85-4c6e-4706-a8a7-dbae47aef02a req-0e79a25c-9857-489f-b5e3-7c06a62c8895 tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 with Priority: HIGHEST for action security_group_members [ 1333.328384] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 with Priority: HIGHEST for action security_group_members [ 1333.328726] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.328854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.328918] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.329356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.329356] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.329542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.329542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.329679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.329763] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.329862] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5494c64-0d9d-4ed2-b10e-fd2df70e7907',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.591691] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-891 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.591885] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.592024] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.592289] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.592547] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.592717] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.593250] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.593250] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.593371] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.593492] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1333.593622] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1333.593807] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1333.593951] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1333.594083] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1333.594200] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1333.594370] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1333.614629] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1333.614822] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1333.614935] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1333.615121] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-891" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.615440] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-8c706047-67d6-478a-907c-28b1fa392818 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.615614] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-8c706047-67d6-478a-907c-28b1fa392818" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.615737] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-8c706047-67d6-478a-907c-28b1fa392818" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.616088] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-8c706047-67d6-478a-907c-28b1fa392818" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.616235] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c706047-67d6-478a-907c-28b1fa392818',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.832172] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.832349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.832349] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.832550] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.832642] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.832845] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.832965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.833059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.833160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.833236] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.833323] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 already deleted. [ 1333.833408] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.118886] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.119135] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.119280] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.119589] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.119750] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.119910] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 8c706047-67d6-478a-907c-28b1fa392818 not found, creating... [ 1334.120178] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.120344] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.120490] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.120709] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.120853] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.121148] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.121309] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.121433] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.121644] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.121781] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.121925] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 8c706047-67d6-478a-907c-28b1fa392818 is going to be created. [ 1334.143368] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.143570] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.143699] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.143938] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.144180] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.144417] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-8c706047-67d6-478a-907c-28b1fa392818" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.254859] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 in Status: SUCCESS [ 1334.254859] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5921dd09-1c8b-4cd1-8a86-569cea9e50d1 deletion is rescheduled due to dependency. [ 1334.254859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5921dd09-1c8b-4cd1-8a86-569cea9e50d1" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.699950] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 in Status: SUCCESS [ 1334.699950] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 deletion is rescheduled due to dependency. [ 1334.699950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.800187] env[68109]: INFO networking_nsxv3.common.synchronization [req-d0e2ed85-4c6e-4706-a8a7-dbae47aef02a req-b69579fb-fe61-4770-b8bf-c787c30ce6ea service nova] Enqueued Resource ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 with Priority: HIGHEST for action security_group_rules [ 1334.800187] env[68109]: INFO networking_nsxv3.common.synchronization [req-d0e2ed85-4c6e-4706-a8a7-dbae47aef02a req-b69579fb-fe61-4770-b8bf-c787c30ce6ea service nova] Enqueued Resource ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 with Priority: HIGHEST for action security_group_members [ 1334.800187] env[68109]: INFO networking_nsxv3.common.synchronization [req-d0e2ed85-4c6e-4706-a8a7-dbae47aef02a req-b69579fb-fe61-4770-b8bf-c787c30ce6ea service nova] Enqueued Resource ID: 8c706047-67d6-478a-907c-28b1fa392818 with Priority: HIGHEST for action port [ 1334.800187] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 with Priority: HIGHEST for action security_group_rules [ 1334.800187] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 with Priority: HIGHEST for action security_group_members [ 1334.800187] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c706047-67d6-478a-907c-28b1fa392818 with Priority: HIGHEST for action port [ 1334.801204] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.801481] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.801681] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.802011] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.802779] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5494c64-0d9d-4ed2-b10e-fd2df70e7907',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.803154] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.803297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.803347] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.803900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.803900] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.803900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.803900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.804163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.804163] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.804163] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5494c64-0d9d-4ed2-b10e-fd2df70e7907',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.804833] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c706047-67d6-478a-907c-28b1fa392818 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.804957] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c706047-67d6-478a-907c-28b1fa392818" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.805028] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c706047-67d6-478a-907c-28b1fa392818" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.805824] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c706047-67d6-478a-907c-28b1fa392818" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.805959] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c706047-67d6-478a-907c-28b1fa392818',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.307536] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.307676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.307870] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5494c64-0d9d-4ed2-b10e-fd2df70e7907',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.308768] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c706047-67d6-478a-907c-28b1fa392818 with status ACTIVE [ 1335.308946] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.309073] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.309146] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.309370] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.309446] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.309615] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.309703] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.309761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.309915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.309990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.310836] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.310836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.311086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.311086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.311161] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.311200] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c706047-67d6-478a-907c-28b1fa392818 is going to be updated. [ 1335.331988] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.332209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.332209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.332380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.332515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.332660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c706047-67d6-478a-907c-28b1fa392818" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.813290] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5494c64-0d9d-4ed2-b10e-fd2df70e7907',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.253379] env[68109]: INFO networking_nsxv3.common.synchronization [None req-d1784905-eee8-4f71-9763-eb2fc36e232a tempest-AttachVolumeTestJSON-790066154 tempest-AttachVolumeTestJSON-790066154-project-member] Enqueued Resource ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 with Priority: HIGHEST for action security_group_rules [ 1336.253844] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 with Priority: HIGHEST for action security_group_rules [ 1336.254164] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.254282] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.254351] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.254605] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.254688] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('873c74c9-87f8-4f4d-95fb-cbd6d353ca77',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.316181] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.316335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.316409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.316606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.316694] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.316791] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 is going to be created. [ 1336.344670] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.344837] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.344886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.345750] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.345750] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.353773] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 in Status: UNINITIALIZED for 2s [ 1336.358861] env[68109]: INFO networking_nsxv3.common.synchronization [None req-4874eadc-b266-462b-9c85-0aff0812cc1e tempest-AttachVolumeTestJSON-790066154 tempest-AttachVolumeTestJSON-790066154-project-member] Enqueued Resource ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 with Priority: HIGHEST for action security_group_rules [ 1336.359404] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 with Priority: HIGHEST for action security_group_rules [ 1336.360190] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.360296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.774347] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.774592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.774592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.774857] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.774948] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.775074] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 already deleted. [ 1336.775343] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.775447] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.775628] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.775785] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('873c74c9-87f8-4f4d-95fb-cbd6d353ca77',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.317857] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.318246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.318246] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.318353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.318496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.318621] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 already deleted. [ 1337.318726] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.363499] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 in Status: SUCCESS [ 1338.364091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.364091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.364091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.364378] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.364378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.364551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.364708] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.364778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.364862] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.364945] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5494c64-0d9d-4ed2-b10e-fd2df70e7907',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.867557] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5494c64-0d9d-4ed2-b10e-fd2df70e7907',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.370808] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5494c64-0d9d-4ed2-b10e-fd2df70e7907: rpc.has_security_group_logging(os_id): False [ 1339.387049] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.387049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.387049] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.387344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.387533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.387821] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.387931] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.388081] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.388187] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.388301] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.388408] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 is going to be created. [ 1339.443451] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.443665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.443665] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.443842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.444023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.454372] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 in Status: IN_PROGRESS for 2s [ 1341.360649] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1341.360932] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1341.467098] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 in Status: SUCCESS [ 1341.467335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.603431] env[68109]: INFO networking_nsxv3.common.synchronization [req-27662053-f122-4f84-a5a3-623e4f0c7104 req-560e9097-c317-4691-ab66-abd730751288 tempest-AttachVolumeTestJSON-790066154 tempest-AttachVolumeTestJSON-790066154-project-member] Enqueued Resource ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 with Priority: HIGHEST for action security_group_members [ 1341.603958] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 with Priority: HIGHEST for action security_group_members [ 1341.604279] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.604405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.604476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.604718] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.604870] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.604966] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.605231] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.605407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.605532] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.605582] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('873c74c9-87f8-4f4d-95fb-cbd6d353ca77',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.861063] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-132 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.861205] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-132" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.861343] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-132" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.861667] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-132" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.861948] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.863028] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.863115] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.863356] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.863515] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.863746] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1341.863886] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1341.864017] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1341.864150] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1341.864336] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1341.864478] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1341.864623] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1341.882678] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1341.882850] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1341.882991] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1341.883193] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-132" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.883503] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-9fb0e202-ae2b-4f41-a0c8-9c132a49eb95 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.883672] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-9fb0e202-ae2b-4f41-a0c8-9c132a49eb95" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.883801] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-9fb0e202-ae2b-4f41-a0c8-9c132a49eb95" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.884193] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-9fb0e202-ae2b-4f41-a0c8-9c132a49eb95" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.884288] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fb0e202-ae2b-4f41-a0c8-9c132a49eb95',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.108642] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.109033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.109033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.109191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.109258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.109551] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.109680] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.109733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.109947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.110115] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.110115] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 already deleted. [ 1342.110276] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.387402] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.387730] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.387772] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.388080] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.388247] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.388409] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 9fb0e202-ae2b-4f41-a0c8-9c132a49eb95 not found, creating... [ 1342.388683] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.388844] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.388969] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.389219] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.389402] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.389685] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.389848] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.389970] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.390206] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.390387] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.390554] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 9fb0e202-ae2b-4f41-a0c8-9c132a49eb95 is going to be created. [ 1342.409683] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.409885] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.409938] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.410225] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.410464] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.410696] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-9fb0e202-ae2b-4f41-a0c8-9c132a49eb95" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.078027] env[68109]: INFO networking_nsxv3.common.synchronization [req-27662053-f122-4f84-a5a3-623e4f0c7104 req-83001805-c1fa-413c-bf5f-e0d407df985d service nova] Enqueued Resource ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 with Priority: HIGHEST for action security_group_rules [ 1343.078232] env[68109]: INFO networking_nsxv3.common.synchronization [req-27662053-f122-4f84-a5a3-623e4f0c7104 req-83001805-c1fa-413c-bf5f-e0d407df985d service nova] Enqueued Resource ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 with Priority: HIGHEST for action security_group_members [ 1343.078377] env[68109]: INFO networking_nsxv3.common.synchronization [req-27662053-f122-4f84-a5a3-623e4f0c7104 req-83001805-c1fa-413c-bf5f-e0d407df985d service nova] Enqueued Resource ID: 9fb0e202-ae2b-4f41-a0c8-9c132a49eb95 with Priority: HIGHEST for action port [ 1343.080042] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 with Priority: HIGHEST for action security_group_rules [ 1343.080042] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 with Priority: HIGHEST for action security_group_members [ 1343.080042] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fb0e202-ae2b-4f41-a0c8-9c132a49eb95 with Priority: HIGHEST for action port [ 1343.080042] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.080042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.080042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.080042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.080042] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('873c74c9-87f8-4f4d-95fb-cbd6d353ca77',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.081173] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.081173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.081173] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.081372] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.081372] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.081490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.081530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.081648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.081726] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.081838] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('873c74c9-87f8-4f4d-95fb-cbd6d353ca77',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.082612] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fb0e202-ae2b-4f41-a0c8-9c132a49eb95 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.082734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fb0e202-ae2b-4f41-a0c8-9c132a49eb95" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.082734] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fb0e202-ae2b-4f41-a0c8-9c132a49eb95" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.082914] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fb0e202-ae2b-4f41-a0c8-9c132a49eb95" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.082914] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fb0e202-ae2b-4f41-a0c8-9c132a49eb95',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.587341] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.587341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.587341] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('873c74c9-87f8-4f4d-95fb-cbd6d353ca77',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.587341] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fb0e202-ae2b-4f41-a0c8-9c132a49eb95 with status ACTIVE [ 1343.587341] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.587341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.587341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.587341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.587341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.587341] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.587341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.587341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.587341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.587341] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.588213] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.588213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.588213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.589282] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.589393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.589487] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fb0e202-ae2b-4f41-a0c8-9c132a49eb95 is going to be updated. [ 1343.611767] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.611911] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.611982] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.612221] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.612355] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.612515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fb0e202-ae2b-4f41-a0c8-9c132a49eb95" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.093441] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('873c74c9-87f8-4f4d-95fb-cbd6d353ca77',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.595572] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.595942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.595942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.596039] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.596086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.596182] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 is going to be created. [ 1344.619330] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.619533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.619533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.619717] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.619877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.629031] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 in Status: UNINITIALIZED for 2s [ 1346.641169] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 in Status: SUCCESS [ 1346.641540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.641540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.641712] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.641893] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.642016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.642086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.642233] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.642311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.642398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.642517] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('873c74c9-87f8-4f4d-95fb-cbd6d353ca77',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.144465] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('873c74c9-87f8-4f4d-95fb-cbd6d353ca77',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.647299] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 873c74c9-87f8-4f4d-95fb-cbd6d353ca77: rpc.has_security_group_logging(os_id): False [ 1347.665333] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.665473] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.665539] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.665733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.665860] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.666051] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.666155] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.666215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.666365] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.666441] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.666530] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 is going to be created. [ 1347.735481] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.735663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.735663] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.735853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.736037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.746324] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 in Status: IN_PROGRESS for 2s [ 1348.080813] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.080813] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1349.760589] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 in Status: SUCCESS [ 1349.761232] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.082029] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.082451] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1358.083683] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1358.084034] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1363.084578] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.084846] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1368.086403] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.086403] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1373.087603] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.087603] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1378.088387] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1378.088387] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1383.089431] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.089431] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1388.089934] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1388.090313] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.090884] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.091275] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.250256] env[68109]: INFO networking_nsxv3.common.synchronization [req-207830bc-851a-413f-9feb-bbaf2249863a req-a5d432e9-14fb-42ec-a611-eef61983bd01 tempest-AttachVolumeNegativeTest-1266470975 tempest-AttachVolumeNegativeTest-1266470975-project-member] Enqueued Resource ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 with Priority: HIGHEST for action security_group_members [ 1397.250256] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 with Priority: HIGHEST for action security_group_members [ 1397.250256] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.250540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.250540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.250650] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.250800] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.250899] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.250958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.251129] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.251213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.251308] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5494c64-0d9d-4ed2-b10e-fd2df70e7907',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.753946] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.754130] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.754204] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.754413] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.754505] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.754696] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.754791] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.754853] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.755033] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.755132] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.755223] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 is going to be updated. [ 1397.782745] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.782874] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.782932] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.783245] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.783393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.797435] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 in Status: IN_PROGRESS for 2s [ 1399.807069] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 in Status: SUCCESS [ 1399.807431] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 deletion is rescheduled due to dependency. [ 1399.807431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.250799] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.251212] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1404.820172] env[68109]: INFO networking_nsxv3.common.synchronization [None req-638afe13-8efa-49cc-b08c-c4ef608b296f tempest-ServerActionsTestJSON-1240277946 tempest-ServerActionsTestJSON-1240277946-project-member] Enqueued Resource ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 with Priority: HIGHEST for action security_group_rules [ 1404.820593] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 with Priority: HIGHEST for action security_group_rules [ 1404.820887] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.821062] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.821121] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.821364] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.821447] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd1b2b33-5483-4ce2-9ea7-cb66a4912b25',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.889877] env[68109]: INFO networking_nsxv3.common.synchronization [None req-e3f3d2c3-2a8e-4b3e-93a5-124eb7dd3107 tempest-ServerActionsTestJSON-1240277946 tempest-ServerActionsTestJSON-1240277946-project-member] Enqueued Resource ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 with Priority: HIGHEST for action security_group_rules [ 1404.890815] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 with Priority: HIGHEST for action security_group_rules [ 1404.890815] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.891026] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.343060] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.343356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.343356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.343515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.343574] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.343672] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 already deleted. [ 1405.343754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.343904] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.344070] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.344151] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd1b2b33-5483-4ce2-9ea7-cb66a4912b25',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.863104] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.863515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.863515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.863590] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.863733] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.863844] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 already deleted. [ 1405.863933] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.891419] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1409.891778] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1410.039158] env[68109]: INFO networking_nsxv3.common.synchronization [req-65e8ef2b-3d2d-4582-a8ba-bf9f094d8d81 req-603770b1-b3dc-4b46-9b5d-7ea9bea14168 tempest-ServerActionsTestJSON-1240277946 tempest-ServerActionsTestJSON-1240277946-project-member] Enqueued Resource ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 with Priority: HIGHEST for action security_group_members [ 1410.039335] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 with Priority: HIGHEST for action security_group_members [ 1410.039633] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.039784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.039827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.040101] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.040257] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.040358] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.040411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.040568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.040651] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.040743] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd1b2b33-5483-4ce2-9ea7-cb66a4912b25',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.333297] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-802 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.333297] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.333297] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.333297] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.333297] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.333297] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.333769] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.334162] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.334440] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.334773] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1410.335063] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1410.335332] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1410.335564] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1410.335792] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1410.336143] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1410.336649] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1410.359446] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1410.359446] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1410.359446] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1410.359446] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.359446] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-fccebf54-f189-404f-8f83-82aed1c2bba2 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.359446] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-fccebf54-f189-404f-8f83-82aed1c2bba2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.359446] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-fccebf54-f189-404f-8f83-82aed1c2bba2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.359446] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-fccebf54-f189-404f-8f83-82aed1c2bba2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.359446] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fccebf54-f189-404f-8f83-82aed1c2bba2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.544100] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.544100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.544100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.544100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.544100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.544100] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.544100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.544100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.544100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.544100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.544100] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 already deleted. [ 1410.544100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.862282] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.862282] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.862282] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.862550] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.862550] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.863187] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port fccebf54-f189-404f-8f83-82aed1c2bba2 not found, creating... [ 1410.863187] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.863187] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.863372] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.863613] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.863613] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.863896] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.864067] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.864194] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.864474] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.864697] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.864783] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: fccebf54-f189-404f-8f83-82aed1c2bba2 is going to be created. [ 1410.885765] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.885982] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.886110] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.886524] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.886754] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.886984] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-fccebf54-f189-404f-8f83-82aed1c2bba2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.589693] env[68109]: INFO networking_nsxv3.common.synchronization [req-65e8ef2b-3d2d-4582-a8ba-bf9f094d8d81 req-f7535d73-6bc8-4956-a35e-b3d2ad7d4c7d service nova] Enqueued Resource ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 with Priority: HIGHEST for action security_group_rules [ 1411.589941] env[68109]: INFO networking_nsxv3.common.synchronization [req-65e8ef2b-3d2d-4582-a8ba-bf9f094d8d81 req-f7535d73-6bc8-4956-a35e-b3d2ad7d4c7d service nova] Enqueued Resource ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 with Priority: HIGHEST for action security_group_members [ 1411.590055] env[68109]: INFO networking_nsxv3.common.synchronization [req-65e8ef2b-3d2d-4582-a8ba-bf9f094d8d81 req-f7535d73-6bc8-4956-a35e-b3d2ad7d4c7d service nova] Enqueued Resource ID: fccebf54-f189-404f-8f83-82aed1c2bba2 with Priority: HIGHEST for action port [ 1411.590341] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 with Priority: HIGHEST for action security_group_rules [ 1411.590499] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 with Priority: HIGHEST for action security_group_members [ 1411.590635] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fccebf54-f189-404f-8f83-82aed1c2bba2 with Priority: HIGHEST for action port [ 1411.591305] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.591453] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.591522] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.591714] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.591795] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd1b2b33-5483-4ce2-9ea7-cb66a4912b25',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.592648] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.593050] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.593154] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.593414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.593511] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.593693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.593693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.593842] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.593971] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.594087] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd1b2b33-5483-4ce2-9ea7-cb66a4912b25',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.595034] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-fccebf54-f189-404f-8f83-82aed1c2bba2 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.595034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fccebf54-f189-404f-8f83-82aed1c2bba2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.595034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fccebf54-f189-404f-8f83-82aed1c2bba2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.595283] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fccebf54-f189-404f-8f83-82aed1c2bba2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.595283] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fccebf54-f189-404f-8f83-82aed1c2bba2',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.097233] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.097739] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.097739] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd1b2b33-5483-4ce2-9ea7-cb66a4912b25',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.100129] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fccebf54-f189-404f-8f83-82aed1c2bba2 with status ACTIVE [ 1412.100385] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.100509] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.100611] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.100784] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.100877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.101073] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.101181] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.101248] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.101411] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.101491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.101670] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.101766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.101828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.101968] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.102059] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.102148] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fccebf54-f189-404f-8f83-82aed1c2bba2 is going to be updated. [ 1412.120797] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.120945] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.120985] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.121183] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.121313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.121461] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fccebf54-f189-404f-8f83-82aed1c2bba2" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.600299] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd1b2b33-5483-4ce2-9ea7-cb66a4912b25',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.102400] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.102570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.102570] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.102810] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.102900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.103010] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 is going to be created. [ 1413.124530] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.124687] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.124738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.124892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.125066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.133061] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 in Status: UNINITIALIZED for 2s [ 1415.143861] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 in Status: SUCCESS [ 1415.145190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.145190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.145190] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.145190] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.145437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.145437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.145437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.145555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.145591] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.145663] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd1b2b33-5483-4ce2-9ea7-cb66a4912b25',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.647984] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd1b2b33-5483-4ce2-9ea7-cb66a4912b25',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.150191] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd1b2b33-5483-4ce2-9ea7-cb66a4912b25: rpc.has_security_group_logging(os_id): False [ 1416.174178] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.174386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.174501] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.174774] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.174892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.175190] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.175317] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.175403] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.175593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.175699] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.175839] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 is going to be created. [ 1416.235261] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.235450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.235450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.235619] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.235795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.244943] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 in Status: IN_PROGRESS for 2s [ 1416.591901] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.592062] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1417.947519] env[68109]: INFO networking_nsxv3.common.synchronization [req-dc3c564a-04b4-4d45-9bc2-784ffa6707b2 req-3734caa2-e419-48f4-9c05-3fd52cecb36a tempest-AttachVolumeTestJSON-790066154 tempest-AttachVolumeTestJSON-790066154-project-member] Enqueued Resource ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 with Priority: HIGHEST for action security_group_members [ 1417.947857] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 with Priority: HIGHEST for action security_group_members [ 1417.948242] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.948386] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.948451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.948980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.948980] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.948980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.948980] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.949262] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.949366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.949485] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('873c74c9-87f8-4f4d-95fb-cbd6d353ca77',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1418.257811] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 in Status: SUCCESS [ 1418.258088] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.452414] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.452613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.452613] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.452795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.452892] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.453096] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.453227] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.453294] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.453451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.453526] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.453617] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 is going to be updated. [ 1418.478231] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.478422] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.478497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.478761] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.478964] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.487309] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 in Status: IN_PROGRESS for 2s [ 1420.498373] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 in Status: SUCCESS [ 1420.498752] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 deletion is rescheduled due to dependency. [ 1420.498752] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.949231] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1422.949582] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1427.950739] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1427.951161] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1432.951283] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1432.951648] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1437.952289] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1437.952708] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1442.953792] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1442.954185] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1447.955177] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1447.955550] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1452.956732] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1452.957133] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1457.958144] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1457.958453] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1462.959417] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1462.959874] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1467.960311] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1467.960606] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1472.961826] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1472.962319] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1477.962724] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1477.963134] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.963657] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1482.964079] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1487.964704] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1487.965142] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1492.966066] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1492.966066] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1497.966778] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1497.967217] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.701977] env[68109]: INFO networking_nsxv3.common.synchronization [req-ec18b6f8-ee83-4bb8-95f9-0add084d070f req-4eb8720f-a779-47dc-a836-fa79436bb54e tempest-ServerActionsTestJSON-1240277946 tempest-ServerActionsTestJSON-1240277946-project-member] Enqueued Resource ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 with Priority: HIGHEST for action security_group_members [ 1499.702510] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 with Priority: HIGHEST for action security_group_members [ 1499.702810] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.702942] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.703016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.703209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.703360] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.703457] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.703536] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.704208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.704208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.704208] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd1b2b33-5483-4ce2-9ea7-cb66a4912b25',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1500.206329] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.206540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.206540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.206765] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.206851] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.207061] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.207172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.207229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.207367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.207484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.207552] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 is going to be updated. [ 1500.243336] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.243496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.243540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.243696] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.243827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.251184] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 in Status: IN_PROGRESS for 2s [ 1502.264758] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 in Status: SUCCESS [ 1502.264758] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 deletion is rescheduled due to dependency. [ 1502.264758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.703580] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1504.703580] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1509.704826] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1509.705107] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1514.706020] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1514.706360] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1519.707140] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1519.707530] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1524.641373] env[68109]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1524.641740] env[68109]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8ff72c7c-b165-44ba-94b0-2eef41721b3e None None] NSXv3 Agent Agent loop - iteration:4 started [ 1524.708243] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1524.708413] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1529.709338] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1529.709338] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1532.511609] env[68109]: INFO networking_nsxv3.common.synchronization [req-aa72c9ab-c3be-4c48-a97e-50d5ebff961f req-15f98746-0b43-4710-b5da-19717125eeb8 tempest-ServerActionsTestJSON-1240277946 tempest-ServerActionsTestJSON-1240277946-project-member] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1532.512211] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1532.512481] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.512545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.512583] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.513249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.513249] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1532.513249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1532.513249] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1532.513497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1532.513497] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1532.513575] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.015949] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.016234] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.016289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.016556] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.016679] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.016951] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.017098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.017184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.017383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.017488] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.017611] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 is going to be updated. [ 1533.044511] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.044674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.044716] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.044925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.045120] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.052719] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: IN_PROGRESS for 2s [ 1535.064464] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: SUCCESS [ 1535.064769] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 deletion is rescheduled due to dependency. [ 1535.064769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.513675] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1537.513924] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1541.461483] env[68109]: INFO networking_nsxv3.common.synchronization [req-d7c913d6-56a0-425f-a758-c23240dee40f req-c683355e-2a67-4386-b5b0-d31b2dfc2466 tempest-ServerActionsTestJSON-1240277946 tempest-ServerActionsTestJSON-1240277946-project-member] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1541.461860] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1541.462094] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.462223] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.462288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.462482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.462637] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.462737] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.462800] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.462943] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.463036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.463129] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.484353] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.484353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.484353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.484542] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.484542] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.714660] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-802 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.714865] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.714993] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.715273] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.715578] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.715745] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.715865] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.716100] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.716248] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.716463] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1541.716579] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1541.716799] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1541.716799] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1541.716933] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1541.717031] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1541.717170] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1541.739480] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1541.739635] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1541.739777] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1541.739947] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.740265] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-372f657c-4278-44f7-bb87-60f37f68775d taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.740433] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-372f657c-4278-44f7-bb87-60f37f68775d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.740556] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-372f657c-4278-44f7-bb87-60f37f68775d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.740848] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-372f657c-4278-44f7-bb87-60f37f68775d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.740986] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('372f657c-4278-44f7-bb87-60f37f68775d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.965283] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.965484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.965484] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.965662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.965754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.965955] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.966069] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.966141] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.966283] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.966370] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.966459] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 is going to be updated. [ 1541.990245] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.990398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.990440] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.990566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.990693] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.998533] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: IN_PROGRESS for 2s [ 1542.113957] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.244120] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.244120] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.244120] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.244398] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.244537] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.244699] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 372f657c-4278-44f7-bb87-60f37f68775d not found, creating... [ 1542.244963] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.245140] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.245260] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.245473] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.245614] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.245898] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.246069] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.246189] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.246411] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.246848] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.246848] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 372f657c-4278-44f7-bb87-60f37f68775d is going to be created. [ 1542.265230] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.265375] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.265507] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.265734] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.265955] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.266185] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-372f657c-4278-44f7-bb87-60f37f68775d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.615957] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.924103] env[68109]: INFO networking_nsxv3.common.synchronization [req-d7c913d6-56a0-425f-a758-c23240dee40f req-5a533570-42cb-4f35-886d-1b6feb7ecede service nova] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_rules [ 1542.924103] env[68109]: INFO networking_nsxv3.common.synchronization [req-d7c913d6-56a0-425f-a758-c23240dee40f req-5a533570-42cb-4f35-886d-1b6feb7ecede service nova] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1542.924103] env[68109]: INFO networking_nsxv3.common.synchronization [req-d7c913d6-56a0-425f-a758-c23240dee40f req-5a533570-42cb-4f35-886d-1b6feb7ecede service nova] Enqueued Resource ID: 372f657c-4278-44f7-bb87-60f37f68775d with Priority: HIGHEST for action port [ 1542.924103] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_rules [ 1542.924103] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1542.924103] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 372f657c-4278-44f7-bb87-60f37f68775d with Priority: HIGHEST for action port [ 1542.924821] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.925073] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.925252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.925617] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.925802] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.927532] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.927744] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.928125] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-372f657c-4278-44f7-bb87-60f37f68775d taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.928382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-372f657c-4278-44f7-bb87-60f37f68775d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.928639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-372f657c-4278-44f7-bb87-60f37f68775d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.928886] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-372f657c-4278-44f7-bb87-60f37f68775d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.929080] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('372f657c-4278-44f7-bb87-60f37f68775d',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1543.117646] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1543.119025] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1543.427754] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.427909] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.431290] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 372f657c-4278-44f7-bb87-60f37f68775d with status ACTIVE [ 1543.431517] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.431639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.431706] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.431913] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.432010] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.432198] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.432312] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.432366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.432530] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.432607] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.432784] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.432878] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.432938] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.433086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.433158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.433243] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 372f657c-4278-44f7-bb87-60f37f68775d is going to be updated. [ 1543.468665] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.468827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.468827] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.469010] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.469143] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.469292] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-372f657c-4278-44f7-bb87-60f37f68775d" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.909784] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.910210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.910210] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.910297] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.921746] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1543.922641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.923908] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1543.964108] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.964241] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.964315] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.964515] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.975522] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.976239] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1543.976320] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1543.976411] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1544.005660] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: SUCCESS [ 1544.005823] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 deletion is rescheduled due to dependency. [ 1544.005927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.006097] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.006293] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.006466] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.006579] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.006641] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.006785] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.006861] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.006950] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1544.008945] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.009075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.009142] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.009306] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.010077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.010213] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1544.089335] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.089498] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.089563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.089766] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.090065] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.090319] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1544.159957] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.160168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.160168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.160407] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.160728] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.161041] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:29. [ 1544.161155] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'f4a1dac4-1522-4ffc-83a0-0f49e1428151', 'd063caf8-0f34-48a0-8035-c8a07c90a01c', '256c7a06-cd22-48f9-a904-ae2dd6fec0e8', '9f78efa9-13fb-4180-9b01-5be62a5cd4c6', '327a22ab-0003-41d7-851d-6eba37a2b9dc', '3b323145-eb80-4cd0-b113-05cefe5e7b4c', '7dd7db8b-2c17-4640-bd53-bfb063c83711', '9353334a-e1b0-43d9-9c87-a08b8516326e', '1c79bef7-bf07-4509-8ec1-1db749783b03', 'f76ac522-d413-411a-995f-1682c0fc160f', 'cd1b2b33-5483-4ce2-9ea7-cb66a4912b25', 'ee121dc7-4686-4564-b58a-255456cf3857', 'e5494c64-0d9d-4ed2-b10e-fd2df70e7907', '80fea482-6d64-4937-892c-62371db01817', '3775fbff-3109-41e9-a7b4-71b12133d9f0', '873c74c9-87f8-4f4d-95fb-cbd6d353ca77', '04d6d7e9-ac4d-4788-ab37-9ef94a13367a', '5160f4a4-8bae-41f0-ba62-9c251afc33f5', '32c2ad67-dff8-4ece-b3e8-2d6f1363534e', '115f89cb-8059-4b36-912a-10de0703affe', 'd2db7fe9-82f8-4d20-b269-363d052050b8', '5921dd09-1c8b-4cd1-8a86-569cea9e50d1', '2a8ad551-9243-4b5e-a0bd-acf823c5b01f', '367414dc-5bb3-4cf0-b02d-c624234144c1', '0f244466-a6a8-4118-96a9-bf22e5d33c96', 'fe094fad-6ec3-4179-88a0-da40e49c0ff5', 'a1b52ab9-23fb-4785-af13-8d3e64d2b62f', '025fe221-7ef8-4d28-bdd2-f925cbbe673c', '02bc3e4c-0cd7-46a0-8516-a78e344aa1a0'} {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1544.161268] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1544.179409] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.179559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.179615] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.179816] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.179917] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.180044] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1544.180136] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1544.180227] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1544.260194] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.260367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.260367] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.260555] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.261709] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.261956] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1544.262045] env[68109]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=68109) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1544.262118] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1544.262185] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1544.262259] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/29 resources of Type:Security Group Rules [ 1544.262346] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGH for action security_group_rules [ 1544.262442] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d063caf8-0f34-48a0-8035-c8a07c90a01c with Priority: HIGH for action security_group_rules [ 1544.262502] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGH for action security_group_rules [ 1544.262565] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 with Priority: HIGH for action security_group_rules [ 1544.262625] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGH for action security_group_rules [ 1544.262685] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGH for action security_group_rules [ 1544.262744] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGH for action security_group_rules [ 1544.262804] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9353334a-e1b0-43d9-9c87-a08b8516326e with Priority: HIGH for action security_group_rules [ 1544.262863] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGH for action security_group_rules [ 1544.262922] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGH for action security_group_rules [ 1544.262980] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 with Priority: HIGH for action security_group_rules [ 1544.263056] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGH for action security_group_rules [ 1544.263109] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 with Priority: HIGH for action security_group_rules [ 1544.263170] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 80fea482-6d64-4937-892c-62371db01817 with Priority: HIGH for action security_group_rules [ 1544.263230] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGH for action security_group_rules [ 1544.263290] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 with Priority: HIGH for action security_group_rules [ 1544.263350] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGH for action security_group_rules [ 1544.263411] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGH for action security_group_rules [ 1544.263471] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e with Priority: HIGH for action security_group_rules [ 1544.263531] env[68109]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 115f89cb-8059-4b36-912a-10de0703affe with Priority: HIGH for action security_group_rules [ 1544.263621] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1544.512083] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.013865] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.517157] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.517357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.517456] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.517644] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.517767] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.517846] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 is going to be updated. [ 1545.541815] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.542258] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.542385] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.542572] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.542656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.549684] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: IN_PROGRESS for 2s [ 1547.559926] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: SUCCESS [ 1547.560229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.560356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.560566] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.560750] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.560865] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.560928] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.561094] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.561174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.561260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.561376] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.924490] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1547.924696] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=1 [ 1547.924748] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGH for action security_group_rules [ 1547.924838] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 with Priority: HIGH for action security_group_rules [ 1547.925335] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 with Priority: HIGH for action security_group_rules [ 1547.925335] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 with Priority: HIGH for action security_group_rules [ 1547.925335] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 115f89cb-8059-4b36-912a-10de0703affe with Priority: HIGH for action security_group_rules [ 1547.925335] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e with Priority: HIGH for action security_group_rules [ 1547.925335] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 with Priority: HIGH for action security_group_rules [ 1547.925551] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a with Priority: HIGH for action security_group_rules [ 1547.925551] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80fea482-6d64-4937-892c-62371db01817 with Priority: HIGH for action security_group_rules [ 1547.925632] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 with Priority: HIGH for action security_group_rules [ 1547.925671] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 with Priority: HIGH for action security_group_rules [ 1547.925731] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee121dc7-4686-4564-b58a-255456cf3857 with Priority: HIGH for action security_group_rules [ 1547.925821] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 with Priority: HIGH for action security_group_rules [ 1547.925906] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76ac522-d413-411a-995f-1682c0fc160f with Priority: HIGH for action security_group_rules [ 1547.925991] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 with Priority: HIGH for action security_group_rules [ 1547.926092] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c with Priority: HIGH for action security_group_rules [ 1547.926180] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9353334a-e1b0-43d9-9c87-a08b8516326e with Priority: HIGH for action security_group_rules [ 1547.926266] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc with Priority: HIGH for action security_group_rules [ 1547.926351] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d063caf8-0f34-48a0-8035-c8a07c90a01c with Priority: HIGH for action security_group_rules [ 1547.926438] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 with Priority: HIGH for action security_group_rules [ 1547.926789] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.926895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.927118] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.927226] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.927289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.927490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.927570] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('256c7a06-cd22-48f9-a904-ae2dd6fec0e8',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.928514] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7dd7db8b-2c17-4640-bd53-bfb063c83711 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.928630] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.928698] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.928900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.928967] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7dd7db8b-2c17-4640-bd53-bfb063c83711',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.930014] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3775fbff-3109-41e9-a7b4-71b12133d9f0 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.930139] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.930208] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.930390] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.930466] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3775fbff-3109-41e9-a7b4-71b12133d9f0',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.931171] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-115f89cb-8059-4b36-912a-10de0703affe taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.931295] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.931398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.931588] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.931720] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('115f89cb-8059-4b36-912a-10de0703affe',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.932428] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32c2ad67-dff8-4ece-b3e8-2d6f1363534e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.932575] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.932643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.932808] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.932891] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32c2ad67-dff8-4ece-b3e8-2d6f1363534e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.933639] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.933778] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.933818] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.933974] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.934066] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5160f4a4-8bae-41f0-ba62-9c251afc33f5',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.934901] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.935017] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.935086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.935251] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.935334] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04d6d7e9-ac4d-4788-ab37-9ef94a13367a',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.936069] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80fea482-6d64-4937-892c-62371db01817 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.936191] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.936266] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.936435] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.936518] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80fea482-6d64-4937-892c-62371db01817',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.937241] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.937353] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.937431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.937592] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.937665] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('873c74c9-87f8-4f4d-95fb-cbd6d353ca77',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.938483] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.938600] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.938676] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.938846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.938921] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5494c64-0d9d-4ed2-b10e-fd2df70e7907',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.939650] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee121dc7-4686-4564-b58a-255456cf3857 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.939769] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.939833] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.940009] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.940095] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee121dc7-4686-4564-b58a-255456cf3857',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.940802] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.940961] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.941008] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.941162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.941243] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd1b2b33-5483-4ce2-9ea7-cb66a4912b25',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.941980] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76ac522-d413-411a-995f-1682c0fc160f taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.942102] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.942174] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.942348] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.942422] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76ac522-d413-411a-995f-1682c0fc160f',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.943263] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c79bef7-bf07-4509-8ec1-1db749783b03 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.943382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.943461] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.943633] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.943707] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c79bef7-bf07-4509-8ec1-1db749783b03',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.944443] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.944564] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.944639] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.944803] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.944891] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b323145-eb80-4cd0-b113-05cefe5e7b4c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.945626] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9353334a-e1b0-43d9-9c87-a08b8516326e taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.945747] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.945816] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.945989] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.946073] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9353334a-e1b0-43d9-9c87-a08b8516326e',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.946873] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-327a22ab-0003-41d7-851d-6eba37a2b9dc taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.947036] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.947089] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.947252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.947323] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('327a22ab-0003-41d7-851d-6eba37a2b9dc',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.948063] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d063caf8-0f34-48a0-8035-c8a07c90a01c taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.948182] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.948256] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.948421] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.948526] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d063caf8-0f34-48a0-8035-c8a07c90a01c',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.949224] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.949354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.949405] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.949577] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.949661] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f78efa9-13fb-4180-9b01-5be62a5cd4c6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1547.972413] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.972606] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.972672] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.972901] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.975208] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.975300] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.990965] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.991111] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80fea482-6d64-4937-892c-62371db01817 is going to be deleted. [ 1547.991896] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.992100] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.009209] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.009337] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3775fbff-3109-41e9-a7b4-71b12133d9f0 is going to be deleted. [ 1548.047834] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.047970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.047970] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.048178] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.048264] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.048377] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80fea482-6d64-4937-892c-62371db01817" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.063903] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.064027] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.064095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.064260] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.064342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.064451] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3775fbff-3109-41e9-a7b4-71b12133d9f0" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.064659] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1548.509542] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.509738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.509787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.509958] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.511427] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.511546] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.512186] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.512271] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.512965] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.513072] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.514010] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.514109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.514763] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.514893] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.515504] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.515597] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.516330] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.516424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.517075] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.517169] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.517831] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.517927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.518610] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.518702] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.524832] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1548.525198] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.525287] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.525858] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1548.526258] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.526359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.526929] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1548.527325] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.527410] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.528010] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1548.528382] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.528493] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd1b2b33-5483-4ce2-9ea7-cb66a4912b25 is going to be deleted. [ 1548.529256] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.529455] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.539387] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.539487] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.542389] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.542489] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.543055] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1548.543454] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.543568] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.546053] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1548.546469] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.546593] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9353334a-e1b0-43d9-9c87-a08b8516326e is going to be deleted. [ 1548.547359] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.547540] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.561184] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.561463] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32c2ad67-dff8-4ece-b3e8-2d6f1363534e is going to be deleted. [ 1548.561967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.562149] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.566499] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4a1dac4-1522-4ffc-83a0-0f49e1428151: rpc.has_security_group_logging(os_id): False [ 1548.576563] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.576664] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d063caf8-0f34-48a0-8035-c8a07c90a01c is going to be deleted. [ 1548.577346] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.577516] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.579368] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.579470] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.583284] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.583378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.597650] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.597755] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 115f89cb-8059-4b36-912a-10de0703affe is going to be deleted. [ 1548.598458] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.598627] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.605646] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.605754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.614293] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.614400] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 256c7a06-cd22-48f9-a904-ae2dd6fec0e8 is going to be deleted. [ 1548.615128] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.615303] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.621089] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.621193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.645135] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.645253] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5494c64-0d9d-4ed2-b10e-fd2df70e7907 is going to be deleted. [ 1548.645998] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.646202] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.659300] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.659437] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.661118] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.661218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.663372] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.663481] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7dd7db8b-2c17-4640-bd53-bfb063c83711 is going to be deleted. [ 1548.664218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.664401] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.743647] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.743836] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.752042] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.752156] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 327a22ab-0003-41d7-851d-6eba37a2b9dc is going to be deleted. [ 1548.752961] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.753168] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.795851] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.795962] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.855895] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.856058] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5160f4a4-8bae-41f0-ba62-9c251afc33f5 is going to be deleted. [ 1548.856925] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.857162] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.912900] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.913151] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04d6d7e9-ac4d-4788-ab37-9ef94a13367a is going to be deleted. [ 1548.914095] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.914344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.915780] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.915888] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.946098] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.946261] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.980928] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.981116] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.991279] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.991452] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f78efa9-13fb-4180-9b01-5be62a5cd4c6 is going to be deleted. [ 1548.992345] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.992586] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.012091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.012182] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76ac522-d413-411a-995f-1682c0fc160f is going to be deleted. [ 1549.012861] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.013048] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.044243] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.044366] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.095075] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.095238] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee121dc7-4686-4564-b58a-255456cf3857 is going to be deleted. [ 1549.096052] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.096278] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.110197] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.110320] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.168845] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.169064] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.169846] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.169969] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c79bef7-bf07-4509-8ec1-1db749783b03 is going to be deleted. [ 1549.170859] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.171080] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.223922] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.224102] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 873c74c9-87f8-4f4d-95fb-cbd6d353ca77 is going to be deleted. [ 1549.224946] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.225185] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.266354] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.266547] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.274754] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.274878] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b323145-eb80-4cd0-b113-05cefe5e7b4c is going to be deleted. [ 1549.275730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.275976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.313082] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.313377] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.313476] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.313543] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.313736] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.313821] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.313917] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 is going to be updated. [ 1549.314877] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.315058] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.315144] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.315265] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd1b2b33-5483-4ce2-9ea7-cb66a4912b25" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.315395] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.315541] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.315618] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.315730] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9353334a-e1b0-43d9-9c87-a08b8516326e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.315869] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.316016] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.316136] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.316199] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32c2ad67-dff8-4ece-b3e8-2d6f1363534e" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.316311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.316450] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.316525] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.316636] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d063caf8-0f34-48a0-8035-c8a07c90a01c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.317119] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.317274] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.317357] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.317471] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-115f89cb-8059-4b36-912a-10de0703affe" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.317589] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.317793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.317793] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.317940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-256c7a06-cd22-48f9-a904-ae2dd6fec0e8" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.318076] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.318193] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.318267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.318378] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5494c64-0d9d-4ed2-b10e-fd2df70e7907" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.318490] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.318623] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.318695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.318797] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7dd7db8b-2c17-4640-bd53-bfb063c83711" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.318927] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.319074] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.319147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.319252] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-327a22ab-0003-41d7-851d-6eba37a2b9dc" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.319361] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.319496] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.319567] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.319674] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5160f4a4-8bae-41f0-ba62-9c251afc33f5" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.319799] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.319930] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.320013] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.320111] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04d6d7e9-ac4d-4788-ab37-9ef94a13367a" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.320217] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.320354] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.320424] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.320535] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f78efa9-13fb-4180-9b01-5be62a5cd4c6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.320656] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.320789] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.320863] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.320947] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76ac522-d413-411a-995f-1682c0fc160f" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.321067] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.321201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.321269] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.321393] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee121dc7-4686-4564-b58a-255456cf3857" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.324940] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.325090] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.325160] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.325306] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.325383] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.325494] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c79bef7-bf07-4509-8ec1-1db749783b03" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.362224] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.362409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.362464] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.362691] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.362782] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.362903] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-873c74c9-87f8-4f4d-95fb-cbd6d353ca77" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.406485] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.406648] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.406695] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.406854] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.406939] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.407066] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b323145-eb80-4cd0-b113-05cefe5e7b4c" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.500160] env[68109]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1549.500750] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.500915] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.500967] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.501171] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.501314] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.537424] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: IN_PROGRESS for 2s [ 1551.552688] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: SUCCESS [ 1551.552971] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.553077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.553289] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.553374] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.055539] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.055787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.055787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.055976] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.056164] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.056274] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.056332] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.056482] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.056558] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.056646] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.056733] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.559260] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.927451] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1552.927650] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1553.061172] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4a1dac4-1522-4ffc-83a0-0f49e1428151: rpc.has_security_group_logging(os_id): False [ 1553.078151] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.078296] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.078338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.078545] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.078634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.078878] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.078979] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.079051] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.079205] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.079288] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.079390] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 is going to be updated. [ 1553.138112] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.138268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.138313] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.138466] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.138601] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.152567] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: IN_PROGRESS for 2s [ 1555.168408] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: SUCCESS [ 1555.168780] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.928838] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1557.929249] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1562.930472] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1562.930891] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1567.931970] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1567.932367] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1572.933490] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1572.933879] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1577.934708] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1577.935145] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1582.935952] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1582.936341] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1587.937156] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1587.937546] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1592.938408] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1592.938794] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1597.939478] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1597.939934] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1602.941084] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1602.941484] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1607.941765] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1607.942165] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1612.943026] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1612.943388] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1617.945167] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1617.945459] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1621.690448] env[68109]: INFO networking_nsxv3.common.synchronization [req-1c63fbb5-7d26-4194-b6db-177766b62cb8 req-709c7db0-1735-4046-bb18-e176ed044ed0 tempest-ServerActionsTestJSON-1240277946 tempest-ServerActionsTestJSON-1240277946-project-member] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1621.690973] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1621.691303] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.691431] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.691499] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.691864] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.691864] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1621.692186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1621.692186] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1621.692311] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1621.692381] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1621.692480] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1622.194424] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.194662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.194662] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.194884] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.194969] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.195178] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.195267] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.195338] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.195475] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.195551] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.195640] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 is going to be updated. [ 1622.232114] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1622.232270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1622.232270] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1622.232439] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1622.232559] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1622.241017] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: IN_PROGRESS for 2s [ 1624.251995] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: SUCCESS [ 1624.251995] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 deletion is rescheduled due to dependency. [ 1624.252380] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1626.692131] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1626.692131] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1628.869900] env[68109]: INFO networking_nsxv3.common.synchronization [req-817f1a70-a8dc-4f84-8326-aaca08d7ce67 req-b82f07fa-7960-4f20-b91d-c029e8fc25ef tempest-ServerActionsTestJSON-1240277946 tempest-ServerActionsTestJSON-1240277946-project-member] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1628.870406] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1628.870711] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.870835] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.870904] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.871268] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.871364] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1628.871465] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1628.871528] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1628.871678] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1628.871759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1628.871852] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1629.123416] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock network-802 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.123622] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.123762] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.124042] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.124325] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.124495] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.124616] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.124840] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.124987] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.125259] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1629.125389] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] NeedRegenerationException {{(pid=68109) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1629.125500] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] no value, waiting for create lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1629.125608] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] value creation lock acquired {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1629.125720] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] No value present for key: 'zone-id' {{(pid=68109) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1629.125822] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Calling creation function for not-yet-present value {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1629.125955] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1629.145862] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1629.146016] env[68109]: DEBUG dogpile.cache.region [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=68109) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1629.146160] env[68109]: DEBUG dogpile.lock [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Released creation lock {{(pid=68109) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1629.146322] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "network-802" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.146585] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock port-395b63c6-c7a1-454f-b2c2-f480ea2f6fc6 taken with stack trace [, , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.146746] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "port-395b63c6-c7a1-454f-b2c2-f480ea2f6fc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.146867] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "port-395b63c6-c7a1-454f-b2c2-f480ea2f6fc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.147153] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "port-395b63c6-c7a1-454f-b2c2-f480ea2f6fc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.147302] env[68109]: DEBUG networking_nsxv3.api.rpc [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('395b63c6-c7a1-454f-b2c2-f480ea2f6fc6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1629.373618] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.373828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.373828] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.374012] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.374113] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.374329] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.374436] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.374500] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.374660] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.374738] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.374827] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 is going to be updated. [ 1629.396859] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.397037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.397037] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.397215] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.397342] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.404733] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: IN_PROGRESS for 2s [ 1629.649787] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.650039] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.650199] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.650485] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.650642] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.650799] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Segment Port 395b63c6-c7a1-454f-b2c2-f480ea2f6fc6 not found, creating... [ 1629.651068] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.651229] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.651352] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.651569] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.651710] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.651991] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.652184] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.652304] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.652513] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.652659] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.652804] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Resource: SegmentPort with ID: 395b63c6-c7a1-454f-b2c2-f480ea2f6fc6 is going to be created. [ 1629.678259] env[68109]: DEBUG networking_nsxv3.common.locking [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1629.678419] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1629.678534] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1629.678753] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1629.679211] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1629.679211] env[68109]: DEBUG oslo_concurrency.lockutils [None req-eb56e730-5fad-4ec1-b11e-800887fc883a None None] Releasing lock "port-395b63c6-c7a1-454f-b2c2-f480ea2f6fc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.336632] env[68109]: INFO networking_nsxv3.common.synchronization [req-817f1a70-a8dc-4f84-8326-aaca08d7ce67 req-59efcf95-3cd3-419f-8a00-6581172cadab service nova] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_rules [ 1630.336632] env[68109]: INFO networking_nsxv3.common.synchronization [req-817f1a70-a8dc-4f84-8326-aaca08d7ce67 req-59efcf95-3cd3-419f-8a00-6581172cadab service nova] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1630.336632] env[68109]: INFO networking_nsxv3.common.synchronization [req-817f1a70-a8dc-4f84-8326-aaca08d7ce67 req-59efcf95-3cd3-419f-8a00-6581172cadab service nova] Enqueued Resource ID: 395b63c6-c7a1-454f-b2c2-f480ea2f6fc6 with Priority: HIGHEST for action port [ 1630.336632] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_rules [ 1630.336632] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1630.336632] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395b63c6-c7a1-454f-b2c2-f480ea2f6fc6 with Priority: HIGHEST for action port [ 1630.337203] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.337335] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.337400] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.337587] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.337667] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1630.338478] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.338596] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.338969] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock port-395b63c6-c7a1-454f-b2c2-f480ea2f6fc6 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.338969] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-395b63c6-c7a1-454f-b2c2-f480ea2f6fc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.338969] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-395b63c6-c7a1-454f-b2c2-f480ea2f6fc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.339147] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-395b63c6-c7a1-454f-b2c2-f480ea2f6fc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.339147] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('395b63c6-c7a1-454f-b2c2-f480ea2f6fc6',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1630.840495] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.840643] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.840855] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 395b63c6-c7a1-454f-b2c2-f480ea2f6fc6 with status ACTIVE [ 1630.841038] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.841151] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.841218] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.841432] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.841521] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.841693] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.841787] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.841845] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.841990] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.842077] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.842274] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.842368] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.842428] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.842564] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.842637] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.842722] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 395b63c6-c7a1-454f-b2c2-f480ea2f6fc6 is going to be updated. [ 1630.862066] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1630.862229] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1630.862280] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1630.862409] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1630.862533] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.862677] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-395b63c6-c7a1-454f-b2c2-f480ea2f6fc6" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1631.413750] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: SUCCESS [ 1631.414098] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 deletion is rescheduled due to dependency. [ 1631.414098] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1631.414219] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1631.414442] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1631.414608] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1631.414739] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1631.414795] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1631.414950] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1631.415045] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1631.415143] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1631.917379] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1632.419814] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1632.921888] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1632.922086] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.922158] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.922396] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.922487] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1632.922594] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 is going to be updated. [ 1632.947794] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1632.947933] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1632.948008] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1632.948213] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1632.948356] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1632.955667] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: IN_PROGRESS for 2s [ 1634.966049] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: SUCCESS [ 1634.966376] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.966376] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.966593] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.966735] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.966849] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.966908] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.967091] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.967172] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.967259] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.967350] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1635.337330] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1635.337488] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1635.469144] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1635.971699] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4a1dac4-1522-4ffc-83a0-0f49e1428151: rpc.has_security_group_logging(os_id): False [ 1635.989035] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1635.989243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1635.989243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1635.989398] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1635.989491] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1635.989748] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1635.989974] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1635.989974] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1635.990133] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1635.990183] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1635.990255] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 is going to be updated. [ 1636.050724] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1636.050940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.050940] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1636.051105] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1636.051243] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1636.062091] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: IN_PROGRESS for 2s [ 1638.074684] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: SUCCESS [ 1638.075023] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1640.338603] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1640.338603] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1645.339643] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1645.339643] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1650.340986] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1650.341447] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1655.343091] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1655.343091] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1660.344905] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1660.345347] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1665.346402] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1665.346784] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1670.347409] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1670.347857] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1675.348530] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1675.348530] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1680.350489] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1680.350489] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1685.352040] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1685.352386] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1690.353497] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1690.353898] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1691.373212] env[68109]: INFO networking_nsxv3.common.synchronization [req-ec3cf4ef-7148-44af-88bd-90d54716181b req-e663f4bb-f7b7-4983-b222-dc93c46f2a12 tempest-ServerActionsTestJSON-1240277946 tempest-ServerActionsTestJSON-1240277946-project-member] Enqueued Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1691.373755] env[68109]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 with Priority: HIGHEST for action security_group_members [ 1691.374073] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4a1dac4-1522-4ffc-83a0-0f49e1428151 taken with stack trace [, , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1691.374201] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1691.374495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1691.374495] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1691.374619] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1691.374707] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1691.374768] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1691.375109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1691.375109] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1691.375109] env[68109]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4a1dac4-1522-4ffc-83a0-0f49e1428151',) {} {{(pid=68109) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1691.878304] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1691.878513] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1691.878513] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1691.878759] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1691.878896] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1691.879181] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1691.879326] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1691.879414] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1691.879634] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1691.879758] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1691.879871] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 is going to be updated. [ 1692.012822] env[68109]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=68109) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1692.013034] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1692.013088] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1692.013305] env[68109]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1692.013462] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1692.026182] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: IN_PROGRESS for 2s [ 1694.036919] env[68109]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 in Status: SUCCESS [ 1694.037344] env[68109]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4a1dac4-1522-4ffc-83a0-0f49e1428151 deletion is rescheduled due to dependency. [ 1694.037344] env[68109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4a1dac4-1522-4ffc-83a0-0f49e1428151" {{(pid=68109) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1696.374316] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1696.374906] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1701.376442] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1701.376821] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1706.378162] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1706.378622] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1711.379321] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1711.379760] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1716.380951] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1716.381320] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1721.382038] env[68109]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1721.382396] env[68109]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0